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S ! 1 Introduction 

In this expository paper, we deal with several questions related to stability and stabiliza- 
^^ , tion of nonlinear finite-dimensional continuous-time systems. We review the basic problem 

\^ I of feedback stabilization, placing an emphasis upon relatively new areas of research which 

CN ' concern stability with respect to "noise" (such as errors introduced by actuators or sensors). 

~^ . The topics covered are as follows: 

o 

0^ ■ 1. Review of Stability and Asymptotic Controllability. 

2. The Problem of Stabilization. 
?3 ' 3. Obstructions to Continuous Stabilization. 

4. Control-Lyapunov Functions and Artstein's Theorem. 
k> \ 5. Discontinuous Feedback. 

d ' 6. Nonsmooth CLF's. 

7. Insensitivity to Small Measurement and Actuator Errors. 

8. Effect of Large Disturbances: Input-to-State Stability. 

9. Comments on Notions Related to ISS. 

The discussion will be largely conceptual. Most technical details are left out, but links to 
precise statements in the literature are given. As a general reference, we direct the reader to 
the following Web site: 



http:/ww^v. math. rut gers.edu/-sontag 
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1.1 Classes of Systems Considered 



We deal with rather general nonlinear finite-dimensional control systems of the following 
form: 

x(t) = fix{t),u{t)) (1) 

where states x{t) £ R" for all t (the integer n is the dimension of the system), and controls 
(or "inputs") are measurable locally essentially bounded maps 

u{-) : [0,cx)) ^1X = M™ 

into the control-value set, which we take here, for simplicity of presentation, to be simply 
an Euclidean space. (However, many of the results generalize easily to more general subsets 
It C R™-.) We assume that / is locally Lipschitz on {x,u), and /(0,0) = 0. In particular, we 
often consider systems with no inputs: 

x{t) = f{x{t)). (2) 

All definitions for such systems are implicitly applied as well to systems with inputs (1) by 
setting u = 0; for instance, we define the global asymptotic stability (GAS) property for (2), 
but we say that (1) is GAS if x = /(a;,0) is. 

The maximal solution x(-) of (1), corresponding to a given initial state x(0) = x", and 
to a given control u, is defined on some maximal interval [0,t^axix",u)) and is denoted 
by x(t,x°,u). For systems with no inputs (2) we write just x(t,x°). In general, we use the 
notation |x| for Euclidean norms, and use ||n||, or ||u||oo for emphasis, to indicate the essential 
supremum of a function u{-). For basic terminology and facts about control systems, we rely 
upon [36]. 

1.2 Stability and Asymptotic Controllability 

The use of "comparison functions" has become widespread in stability analysis, as this for- 
malism allows elegant formulations of most concepts. We recall the relevant definitions here. 
The class of /Coo functions consists of all a : R>o -^ R>o which are continuous, strictly in- 
creasing, unbounded, and satisfy a(0) = 0, cf. Figure 1. The class of ICC functions consists 



Figure 1: A function of class /Coo 

of those (3 : R>o x R>o -^ R>o with the properties that (1) P{-,t) G /Coo for all t, and (2) 
I3{r,t) decreases to zero as t ^ cx). (It is worth remarking, cf. [38], that for each /3 G ICC, 
there exist two functions ai,a2 € /Coo so that (3{r,t) < 02 (ai(r)e~*) for all s,t. Thus, as 
every function of the latter form is in ICC, and since ICC functions are only used in order to 
express upper bounds, in a sense there is no need to introduce the class ICC.) We will also 
use A^ to denote the set of all nondecreasing functions a : R>o -^ R>o- 
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Expressed in this language, the property of global asymptotic stability (GAS) for a system 
with no inputs (2) becomes: 

(3/3g/C£) |x(t,x")| < /3(|x°|,t) Vx°,Vt>0. 

It is an easy exercise to show that this definition is equivalent to the usual "e — J" definition; 
for one implication, simply observe that 

\x{t,x')\ </3(|x"|,0) 

provides the stability (or "small overshoot") property, while 

k(t,x°)| < f3{\x°\,t) ^0 

t— »oo 

gives attractivity. 

More generally, we define what it means for the system with inputs (1) to be (open 
loop, globally) asymptotically controllable (AC). The definition amounts to requiring that for 
each initial state x" there exists some control u = u^oO defined on [0, oo), such that the 
corresponding solution x(t,x°,u) is defined for all t > 0, and converges to zero as t ^ oo, 
with "small" overshoot. Moreover, we wish to rule out the possibility that u{t) becomes 
unbounded for x near zero. The precise formulation is as follows. 

(3/3G/C£)(3aG AA) Vx" G M" 3n(-), \\u\\oo < (t{\x"\) , 

\xit,x'\u)\ < Pi\x°\,t) Vt > 0. 

Finally, we say that k : M" ^ U is a feedback stabilizer for the system with inputs (1) if 
k is locally bounded (that is, k is bounded on each bounded subset of M), A;(0) = 0, and the 
closed-loop system 

X = f{x,k{x)) (3) 

is GAS, i.e. there is some (3 £ ICC so that \x(t)\ < /3(|x(0)|,t) for all solutions and all 
t > 0. Obviously, if there exists a feedback stabilizer for (1), then (1) is also AC (just 
use u(t) := k{x{t,x°)) as u^o). A most natural question is to ask if the converse holds as 
well, namely: is every asymptotically controllable system also feedback stabilizable? We will 
see that the answer is "yes", provided that we allow discontinuous feedbacks k, which in 
turn leads to the technical problem of defining precisely what one means by a "solution" of 
an initial value problem for (1) when f{x,k{x)) is not continuous (since, in that case, the 
standard theorems on existence do not apply). This is a question that is very much central 
to the rest of the paper. 

1.3 Why Stabilization? 

In control problems, there are often ultimate objectives other than stabilization. For example, 
one might merely be interested in making a subset of the state variables (as opposed to the full 
state) approach a desired set point, in which case (after translation of the origin of coordinates 
so as to make the desired values zero) one deals with partial or "output" stability: there is a 
given function y = h{x) and one wishes to make y{t) -^ using suitable control actions. A 
variation of this idea is the formulation of tracking problems, where one wishes the output 
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y{t) to follow a predetermined path y*{t); this can be seen as an output stability problem 
for an "error" signal e(t) = y{t) — y*{t). Yet another variation consists in studying stability 
of invariant sets (as opposed to equilibria); for instance, one may be given a periodic orbit, 
and a feedback is sought so that for the closed-loop system it becomes a limit cycle. Finally, 
one may wish to allow for uncertainties in plant description (adaptive and/or robust control) . 
Many such other objectives can be treated using the techniques that we shall describe; we 
focus on stabilization to an equilibrium because this is the simplest problem in which the 
main technical difficulties can be understood. 



1.4 Regularity of Feedback 

As already mentioned, one of the central issues with which we will be concerned is that of 
dealing with possibly discontinuous feedback laws k. Before addressing that subject, however, 
we will study what can be done with continuous feedback. 

It turns out that requirements away from 0, say asking whether k is continuous or smooth, 
are not very critical; it is often the case that one can "smooth out" a continuous feedback 
(or, even, make it real-analytic, via Grauert's Theorem) away from the origin. So, in order 
to avoid unnecessary complications in exposition due to nonuniqueness, let us call a feedback 
k regular if it is locally Lipschitz on M" \ {0}. For such k, solutions of initial value problems 
X = f{x,k{x)), x(0) = x°, are well defined (at least for small time intervals [0,e)) and, 
provided A: is a stabilizing feedback, are unique (cf. [36], Exercise 5.9.9). 

On the other hand, behavior at the origin cannot be "smoothed out" and, at zero, the 
precise degree of smoothness plays a central role in the theory. For instance, consider the 
system 

X = X + u^ . 

The continuous (and, in fact, smooth away from zero) feedback u = k{x) := —\/2x globally 
stabilizes the system (the closed-loop system becomes x = —x). However, there is no possible 
stabilizing feedback which is differentiable at the origin, since u = k{x) = 0{x) implies that 

X = X + 0{x' ) 

about X = 0, which means that the solution starting at any positive and small point moves 
to the right, instead of towards the origin. (A general result, assuming that A has no purely 
imaginary eigenvalues, cf. [36], Section 5.8, is that if -and only if- x = Ax + Bu + o(x,u) 
can be locally asymptotically stabilized using a feedback which is differentiable at the origin, 
the linearization x = Ax + Bu must be itself stabilizable. In the example that we gave, this 
linearization is just x = x, which is not stabilizable.) 



2 Nonexistence of Regular Feedback 

We now turn to the question of existence of regular feedback stabilizers. We first study a 
comparatively trivial case, namely systems with one state variable and one input. After that, 
we turn to multidimensional systems. 
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2.1 The Special Case n 



m 



There are algebraic obstructions to the stabihzation of i = f{x,u) if the input u appears 
nonhnearly in /. Ignoring the requirement that there be a o" G AA so that controls can be 
picked with ||u|| < (t(|x"|), asymptotic controllability is, for n = m = 1, equivalent to: 



(Vx/0)(3ii) xf{x,u) < 



(4) 



(this is proved in [39]; it is fairly obvious, but some care must be taken to deal with the fact 
that one is allowing arbitrary measurable controls; the argument proceeds by first approxi- 
mating such controls by piecewise constant ones). Let us introduce the following set: 



O := {{x, u) I xf{x, li) < 0} , 
X be the projection into the first coordinate in 

vrO = 



Then, (4) is equivalent 



and let -n : {x,u) 
to: 

E\{0}. 

(One can easily include the requirement "||ti|| < (T(|a;"|)" by asking that for each interval 
[—K,K] C M there must be some compact set Ck C M^ so that [—K,K] C tt{Ck)- For 
simplicity, we ignore this technicality.) In these terms, a stabilizing feedback is nothing else 
than a locally bounded map A; : M ^ M such that /c(0) =0 and so that /c is a section of tt on 
M\{0}: 

{x,k{x)) GO Vx/0. 

For a regular feedback, we ask that k be locally Lipschitz on M \ {0}. 

Clearly, there is no reason for Lipschitz, or for that matter, just continuous, sections of tt 
to exist. As an illustration, take the system 

X = x[{u- if - (x - 1)] [{u + if + {x- 2)] . 

Let 

Oi = {{u + lf <{2-x)} and O2 = {{u - if < {x - I)} 

(see Figure 2). Here, O has three connected components, namely O2 and Oi intersected 




Figure 2: Two regions 
with a; > and x < 0. It is clear that, even though vrO = M, there is no continuous curve 
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(graph of n = k{x)) which is always in O and projects onto M \ {0}. On the other hand, 
there exist many possible feedback stabilizers provided that we allow one discontinuity (e.g., 
dotted curve in figure). It is also possible to provide examples, even with f{x,u) smooth, 
for which an infinite number of switches are needed in any possible stabilizing feedback law. 
The set O could be like the (non-shaded) set in Figure 3 (with an accumulation of smaller 



Figure 3: Infinitely many discontinuities required 

and smaller holes as we approach the origin). Finally, it may even be possible to stabilize 
semiglobally with a regular feedback, meaning that for each compact subset K of the state- 
space there is a regular, even smooth, feedback law u = kxix) such that all states in K get 
driven asymptotically to the origin, but yet it may be impossible to find a single u = k{x) 
which works globally. This illustrated by an example where the set O could be like the (non- 
shaded) set in Figure 4 (one may give explicit equations using trigonometric functions). The 




Figure 4: Semiglobal but no global continuous stabilizers 

figure shows graphs of two stabilizers, which work with respect to two possible intervals in 
M, and for any such interval one may clearly find such a (continuous) curve; however, there 
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is no curve which is the graph of a function u = k{x) and which stays in the non-shaded area 
while projecting onto M \ {0}. 

Time- Varying Feedback 

Although our interest here is primarily in time-invariant feedback u = k{x), it is worth 
pointing out that it is often possible to overcome obstructions to regular feedback stabilization 
by means of the use of time-varying feedback u = k{t,x). A general result in that direction 
was proved in [39], which established that every one-dimensional system can be stabilized 
using k{t, x) continuous (it is not difficult to see that the proof can be adapted to obtain 
k{t,x) periodic in t, for each x). The intuitive idea of the construction can be perhaps 
understood by looking at Figure 2.1. Two feedback laws, regular but not stabilizing (because 



B B 



Figure 5: Time- varying feedback 

their graphs intersect the shaded area which indicates the complement of O) are shown in 
the figure. The "bad" set B = Bt := {x \ xf{x, k{t, x)) > 0} where the closed-loop behavior 
is undesirable moves with time t. The idea is to oscillate now between laws whose graphs are 
between these two graphs, moving slowly in the "<— " direction and faster to the left. The 
effect will be that states to the right of B move to the left until they hit B (and if B moves 
slowly enough, never actually hit while B is moving to the left), but when B moves back 
to the right, the effect on any given state is very short (and hence only a small backwards 
movement happens). More recently, a very different construction of time- varying feedbacks 
was accomplished by Coron, cf. [8], who established a general result valid in any dimension, 
but restricted to systems with no drift, and by Coron and Rosier, cf. [9], for systems for 
which smooth elf's (see later) exist. We will not look into time- varying feedback in this 
paper, however. 



2.2 Obstructions 

When feedback laws are required to be continuous at the origin, new obstructions arise. The 
case of systems with n = m = 1 is also a good way to introduce this subject. The first 
observation is that stabilization about the origin (even if just local) means that we must 
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have, near zero: 



f{x,k{x)) < 



( >0 if X < 
< if X > 
= if X = . 



In fact, all that we need is that f{xi,k{xi)) < for some xi > and f{x2,k{x2)) > for 
some X2 < 0. This guarantees, via the intermediate-value theorem that, if k is continuous, 
the projection 

(— e, e)^]R, X 1-^ /(x,fc(x)) 

is onto a neighborhood of zero, for each e > 0, see Figure 6. It follows, in particular, that 

f(x,k(x)) 



Figure 6: Onto projection, for case n 



m 



the image of 

{—e,e) X {—e,e) -^ M, {x,u) ^^ f{x,u) 

also contains a neighborhood of zero, for any e > (that is, the map (x, u) ^^ /(x, u) is open 
at zero). This last property is intrinsic, being stated in terms of the original data f{x,u) 
and not depending upon the feedback k. Brockett's condition, to be described next, is a 
far-reaching generalization of this argument; in its proof, degree theory replaces the use of 
the intermediate value theorem. 



Logical Decisions are Often Necessary 

If there are global obstacles in the state-space (that is, if the state-space is a proper subset of 
M""), discontinuities in feedback laws cannot in general be avoided. Even if it is in principle 
possible to reach the origin, it may not be possible to find a regular feedback stabilizer. 
Actually, this is fairly obvious, and is illustrated in intuitive terms by Figure 7. We think 
of the position of the (immobile) cat as the origin. In deciding in which way to move, as 
a function of its current position, the dog must at some point in the state-space make a 
discontinuous decision: move to the left or to the right of the obstacle (represented by the 
shaded rectangle)? Formally, this setup can be modeled as a problem in which the state-space 
is the complement in M^ of the obstacle, and the fact that discontinuities are necessary is a 
particular case of a general fact (a theorem of Milnor's), namely that the domain of attraction 
of an asymptotically stable vector field must be diffeomorphic to Euclidean space (which the 
complement of the rectangle is not); see [36] for more on the subject. 

The interesting point is that even if, as in this exposition, we assume that states evolve 
in Euclidean spaces, similar obstructions may arise. These are due not to the topology of the 
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Figure 7: At some point, a discontinuous decision is necessary 

state space, but to "virtual obstacles" implicit in the form of the system equations. These 
obstacles occur when it is impossible to move instantaneously in certain directions, even if it 
is possible to move eventually in every direction ( "nonholonomy" ) . 

Nonholonomy and Brockett's Theorem 

As an illustration, let us consider a model for the "shopping cart" shown in Figure 8 ("knife- 
edge" or "unicycle" are other names for this example). The state is given by the orientation 
6, together with the coordinates xi,X2 of the midpoint between the back wheels. The front 

.^2 




Figure 8: Shopping cart 



wheel is a castor, free to rotate. There is a non-slipping constraint on movement: the velocity 
(i;i,X2)' must be parallel to the vector (cos ^, sin ^)'. This leads to the following equations: 



xi = ui cos 9 
X2 = Ml sin ^ 
e = U2 

where we may view ui as a "drive" command and U2 as a steering control; in practice, one 
would implement these controls by means of differential forces on the two back corners of the 
cart. The feedback transformation zi := 9, Z2 := xi cos 9 + X2 sm9, z^ := xi sinO — X2 cos 9, 
vi := U2, and V2 := ui — U2Z3 brings the system into the system with equations ii = vi, 
Z2 = V2, is = Z1V2 known as "Brockett's example" or "nonholonomic integrator" (yet another 
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change can bring the third equation into the form % = ziV2 — Z2V1). We view the system 
as having state space M^. Although a physicahy more accurate state space would be the 
manifold M^ x S^, the necessary condition to be given is of a local nature, so the global 
structure is unimportant. 

This system is (obviously) completely controllable (in any case, controllability can be 
checked using the Lie algebra rank condition, as in e.g. [36], Exercise 4.3.16), and in particular 
is AC. But we may expect that discontinuities are unavoidable due to the non-slip constraint, 
which does not allow moving from, for example the position xi = 0, ^ = 0, X2 = 1 in a 
straight line towards the origin. This is illustrated intuitively by Figure 9 (we use a line to 
indicate the orientation of the cart). Depending on the initial angle, we may start by rotating 



Figure 9: Which way to turn? 

either clockwise or counterclockwise (and then moving in a straight line towards 0). But a 
discontinuous decision is necessary somewhere. This impossibility is established rigorously 
by means of: 

Theorem A (Brockett [4]) // there is a stabilizing feedback which is regular and continuous 
at zero, then the map {x,u) 1-^ f{x,u) is open at zero. 

The test fails here, since no points of the form (0, e, *) belong to the image of the map 

M^ -^ M"^ : (xi,X2, 0,ui, U2)' ^^ f{x,u) = {ui cosO,ui sin0,ti2)' 

for e G (-7r/2, tt/2), unless e = 0. 

More generally, it is impossible to continuously stabilize any system without drift 

X = Uigi{x) + . . . + Umgmix) = G{x)u 

if m < n and rank[5fi(0), . . . ,gmiO)] = "m (this includes all totally nonholonomic mechanical 
systems). Indeed, under these conditions, the map {x,u) h^ G{x)u cannot contain a neigh- 
borhood of zero in its image, when restricted to a small enough neighborhood of zero. Indeed, 
let us first rearrange the rows of G: 

SO that Gi{x) is of size m x m and is nonsingular for all states x that belong to some 
neighborhood N of the origin. Then, 

° J G Im [iV X M™ ^ R" : (x, u) ^ G{x)u\ ^ a = 

(since Gi{x)u = =^ u = ^ G2{x)u = too). 

If the condition rank[5(i(0), . . . ,gmiO)] = m is violated, we cannot conclude a negative 
result. For instance, the system xi = xiu, X2 = X2U has m = 1 < 2 = n but it can be 
stabilized by means of the feedback law u = — (xf + X2). 
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Observe that for linear systems, Brockett's condition says that 

rank [^, -B] = n 
which is the Hautus controllabihty condition (see e.g. [36], Lemma 3.3.7) at the zero mode. 

Idea of the Proof 

One may prove Brockett's condition in several ways. A proof based on degree theory is 
probably easiest, and proceeds as follows (for details see for instance [36], Section 5.9). The 
basic fact, due to Krasnosel'ski, is that if the system x = F{x) = f{x,k{x)) has the origin 
as an asymptotically stable point and F is regular (since k is) , then the degree (index) of F 
with respect to zero is (—1)", where n is the system dimension. In particular, the degree is 
also nonzero with respect to points p near enough 0, which means that the equation F{x) = p 
can be solved for small p, and hence /(x, u) = p can be solved as well. The proof that the 
degree is (—1)" follows by exhibiting a homotopy, namely 



Ftix^') = ] 



* ,x"] -x° 



1-t' 



between Fq = F and Fi{x) = —x, and noting that the degree of the latter is obviously (— 1)". 
An alternative (and Brockett's original) proof uses Lyapunov functions. Asymptotic stability 
implies the existence of a smooth Lyapunov function V for x = F{x) = f{x,k{x)), so, on 
the boundary dB of a sublevel set B = {x \ V{x) < c} we have that F points towards the 
interior of B, see Figure 10. So for p small, F{x) — p still points to the interior, which means 




Figure 10: Perturbations of F still point inside B 

that B is invariant with respect to the perturbed vector field x = F{x) — p. Provided that 
a fixed-point theorem applies to continuous maps B ^ B, this implies that F{x) — p must 
vanish somewhere in B, that is, the equation F{x) = p can be solved. (Because, for each 
small h > 0, the time-h flow (p o( F — p has a fixed point Xh G B, i.e. (p{h,Xh) = Xh, so 
picking a convergent subsequence Xh ^ x gives that = ''^^ ^'' -^ F{x) — p.) A fixed 
point theorem can indeed be applied, because 5 is a retract of M" (use the fiow itself); note 
that this argument gives a weaker conclusion than the degree condition. 

Another Example 

There is another nice example of these ideas, which will also be useful later when illustrating 
Lyapunov techniques (see [2]). It is closely related to the shopping-cart example; in fact, it 
arises when we control the cart by this procedure: first, we rotate the cart until tangent to, 
either a circle centered on the X2-axis and tangent to the xi-axis (see Figure 11), or the xi- 
axis if we started there; next, we move only with velocities tangential to this circle (steering 
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Figure 11: Cart tangent to circle 



so as to maintain invariance of the circle) . In summary, one obtains a system with state-space 
M?, input space M, and equations 



X = g{x)u , where g{x) 



X-\ OCn 

2X1X2 



The vector field g and typical orbits of g are shown in Figure 12. In this system, all motions 



/ / / y^- 

[ t 1 / / y ^ 
\ I / / / ^ - 

\ \ I I / / / - 
\ \ \ V I / / 
\ \ \ \ \ I / 
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Figure 12: (xf — x"^)-^ + 2xiX2g^ with typical integral manifolds 

along the integral curves of g are allowed (clockwise, counterclockwise, or staying at one 
point). The Brockett condition is satisfied; this is clear if one views the system as a system 
with complex state space (write z = xi + 1x2) with equations: 

z = z u . 

The map (x, u) ^^ g{x)u is (z, u) h^ z^n, which is clearly onto any neighborhood of zero, 
even when restricted to any neighborhood of z=u={^ (take square roots). However, the 
degree condition fails, as for any continuous feedback one would have k{x) 7^ for all x 7^ 
(otherwise, an equilibrium results), so one obtains degree 2 for /(x,fc(x)) = g{x)k{x), and 
not (-1)2 = 1. 

Actually, for this example it is easy to see directly that no regular stabilizing feedback 
can exist. One proof is by noticing that circles would have to be invariant, so motions 
restricted to them would result in globally asymptotically stable vector fields in manifolds 
not diffeomorphic to Euclidean space, contradicting Milnor's theorem. Another proof is 
even easier: take any path 7 : [0,1] -^ M^ with 7(0) = (1,0)' and 7(1) = (—1,0)' and so 
that 7(r) 7^ for all r. Consider the function K{r) := k{'y{r)), which is continuous if k 
was assumed continuous. Since k(0) < (because, otherwise, trajectories of x = g{x)k{x) 
starting at (1,0)' cannot converge to zero, since the positive axis is invariant and g points 
towards the right there) and k(1) > (analogous argument), it follows that K(ro) = for 
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some ro G (0, 1). Therefore, the point x = j{ro) 7^ is such that k(x) = and is therefore 
an equihbrium point, contradicting the fact that u = k{x) is a stabihzer. We shall return to 
this example when discussing control-Lyapunov functions. 

2.3 Control-Lyapunov Functions 

The method of control-Lyapunov functions ("elf's") provides a powerful tool for studying 
stabilization problems, both as a basis of theoretical developments and as a method for 
actual feedback design. 

Before discussing elf's, let us quickly review the classical concept of Lyapunov functions, 
through a simple example. Consider first a damped spring-mass system y + y + y = 0, 
or, in state-space form with xi = y and X2 = y, xi = X2, X2 = —x\ — x^- One way to 
verify global asymptotic stability of the equilibrium a; = is to pick the (Lyapunov) function 
V{x\,X2) '■= I a^i + 3^13^2 + X2, and observe that W{x).f{x) = —\x\ < if x / 0, which 
means that 

along all nonzero solutions, and thus the energy-like function V decreases along all trajecto- 
ries, which, since y is a nondegenerate quadratic form, implies that x{t) decreases, and in 
fact x{t) -^ 0. Of course, in this case one could compute solutions explicitly, or simply note 
that the characteristic equation has all roots with negative real part, but Lyapunov functions 
are a general technique. (In fact, the classical converse theorems of Massera and Kurzweil 
show that, whenever a system is GAS, there always exists a smooth Lyapunov function V.) 
Now let us modify this example to deal with a control system, and consider a forced (but 
undamped) harmonic oscillator x + x = u, i.e. xi = X2, X2 = —xi + u. The damping feedback 
u = —X2 stabilizes the system, but let us pretend that we do not know that. If we take 
the same V as before, now the derivatives along trajectories are, using "y(x,ti)" to denote 
'W{x).f{x,u) and omitting arguments t in x{t) and u{t): 

V{x, u) = —Xi + X1X2 + X2 — {xi + 2x2)u . 

This expression is afhne in u. Thus, if a; is a state such that xi + 2x2 7^ 0, then we may pick 
a control value u (which depends on this current state x) such that V < 0. On the other 
hand, if xi + 2x2 = 0, then the expression reduces to F = —5x2 i^'^^ ^^Y '^)-> "which is negative 
unless X2 (and hence also xi = —2x2) vanishes. 

In conclusion, for each x 7^ there is some u so that V{x, u) < 0. This is, except for some 
technicalities to be discussed, the characterizing property of control-Lyapunov functions. For 
any given compact subset B in M", we now pick some compact subset Uq C It so that 

VxG5,x/0, BuGUo such that V{x,u)<0. (5) 

In principle, then, we could then stabilize the system, for states in B, by using the steepest 

descent feedback law: 

k{x) := argmin W{x) ■ f{x,u) (6) 

ueUo 

("argmin" means "pick any u at which the min is attained"; we restricted U to be assured 
that V{x,u) attains a minimum). Note that the stabilization problem becomes, in these 
terms, a set of static nonlinear programming problems: minimize a function of u, for each x. 
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Global stabilization is also possible, by appropriately picking IXq as a function of the norm of 
x; later we discuss a precise formulation. 

Control-Lyapunov functions, if understood non-technically as the basic paradigm "look 
for a function V{x) with the properties that V{x) ~ if and only if a; ~ 0, and so that for 
each X 7^ it is possible to decrease V{x) by some control action," constitute a very general 
approach to control (sometimes expressed in a dual fashion, as maximization of some measure 
of success). They appear in such disparate areas as A.I. game-playing programs (position 
evaluations), energy arguments for dissipative systems, program termination (Floyd/Dijkstra 
"variant" ) , and learning control ( "critics" implemented by neural-networks) . More relevantly 
to this paper, the idea underlies much of modern feedback control design, as illustrated for 
instance by the books [11, 17, 24, 23, 36]. 

Differentiable elf's: Precise Definition 

We say that a continuous function 

V : W ^ E>o 

is positive definite if V{x) = only if a; = 0, and it is proper (or "weakly coercive") if for 
each a > the set {x \ V{x) < a} is compact, or, equivalently, V{x) ^ cxd as |x| ^ oo (radial 
unboundedness). A property which is equivalent to properness and positive definiteness 
together is: 

{3a,a£JCoo) a{\x\) < V{x) < a{\x\) VxGM". (7) 

A differentiable control- Lyapunov function (elf) is a differentiable function V : M" -^ M>o 
which is proper, positive definite, and infinitesimally decreasing^ meaning that there exists a 
positive definite continuous function W : M" -^ IR>05 and there is some a G AA, so that 

sup min W{x) ■ f{x,u) + W{x) < 0. (8) 

xeR" l«l<o'{|a;|) 

This is basically the same as condition (5), with Uq = the ball of radius o"(|x|) picked as a 
function of x. The main difference is that, instead of saying "Vy(x) • f{x,u) < for x ^ 0" 
we write Vy(x) • f{x, u) < —W{x), where W is negative when x ^ 0. The two definitions are 
equivalent, but the "Hamiltonian" version used here is the correct one for the generalizations 
to be given, to nonsmooth V. 

Theorem B (Artstein [2]) A control-affine system x = go{x)+J2 "^idii^) admits a differen- 
tiable elf if and only if it admits a regular stabilizing feedback. 

The proof of sufficiency is easy: if there is such a k, then the converse Lyapunov theorem, 
applied to the closed-loop system F{x) = f{x, k{x)), provides a smooth V such that 

LfV{x) = VV{x)F{x) < Vx/0. 

This gives that for all nonzero x there is some u (bounded on bounded sets, because k is 
locally bounded by definition of feedback) so that V{x, u) < 0; and one can put this in the 
form (8). 
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The necessity is more interesting. The original proof in [2] proceeds by a nonconstructive 
argument involving partitions of unity, but it is also possible to exhibit explicitly a feedback, 
written as a function 

k {VV{x) • go{x) ,... , VV{x) • <7m(x)) 

of the directional derivatives of V along the vector fields defining the system (universal 
formulas for stabilization). Taking for simplicity m = 1, one such formula is: 



kix):= _^^M±vW±W (0if6 = 0) 
b[x) 

where a{x) := W{x) ■ go{x) and b{x) := W{x) • gi{x). (The expression for k is analytic in 
a, b when x / 0, because the elf property means that a{x) < whenever b{x) = 0, see [36] 
for details.) 

Thus, the question of existence of regular feedback, for control-affine systems, reduces 
to the search for differentiable elf's, and this gives rise to a vast literature dealing with the 
construction of such V^s, see [11, 24, 23, 36] and references therein. Many other theoretical 
issues are also answered by Artstein's theorem. For example, via Kurzweil's converse theorem 
one has that the existence of k merely continuous on M" \ {0} suffices for the existence of 
smooth (infinitely differentiable) V, and from here one may in turn find a k which is smooth 
on M" \ {0}. In addition, one may easily characterize the existence of k continuous at zero as 
well as regular: this is equivalent to the small control property: for each e > there is some 
(5 > so that < |x| < (5 implies that min|u|<j 'W{x) ■ f{x, u) < (if this property holds, the 
universal formula automatically provides such a k). We should note that Artstein provided 
a result valid for general, not necessarily control-affine systems x = f{x,u); however, the 
obtained "feedback" has values in sets of relaxed controls, and is not a feedback law in the 
classical sense. Later, we discuss a different generalization. 

Differentiable elf's will in general not exist, because of obstructions to regular feedback 
stabilization. This leads us naturally into the twin subjects of discontinuous feedbacks and 
non-differentiable elf's. 

3 Discontinuous Feedback 

The previous results and examples show that, in order to develop a satisfactory general 
theory of stabilization, one in which one proves the implication "asymptotic controllability 
implies feedback stabilizability," we must allow discontinuous feedback laws u = k[x). But 
then, a major technical difficulty arises: solutions of the initial-value problem x = f{x, k{x)), 
x{0) = x", interpreted in the classical sense of differentiable functions or even as (absolutely) 
continuous solutions of the integral equation x(t) = x° + j^ f {x{s) , k{x{s))) ds, do not exist 
in general. The only general theorems apply to systems x = F(x) with continuous F. For 
example, there is no solution to x = — signx, x(0) = 0, where signx = —1 for x < and 
sign X = 1 for x > 0. So one cannot even pose the stabilization problem in a mathematically 
consistent sense. 

There is, of course, an extensive literature addressing the question of discontinuous feed- 
back laws for control systems and, more generally, differential equations with discontinuous 
right-hand sides. One of the best-known candidates for the concept of solution of (3) is that 
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of a Filippov solution [12, 13], which is defined as the solution of a certain differential inclu- 
sion with a multivalued right-hand side which is built from f{x, k{x)). Unfortunately, there 
is no hope of obtaining the implication "asymptotic controllability implies feedback stabi- 
lizability" if one interprets solutions of (3) as Filippov solutions. This is a consequence of 
results in [32, 9], which established that the existence of a discontinuous stabilizing feedback 
in the Filippov sense implies the Brockett necessary conditions, and, moreover, for systems 
affine in controls it also implies the existence of regular feedback (which we know is in general 
impossible). 

A different concept of solution originates with the theory of discontinuous positional 
control developed by Krasovskii and Subbotin in the context of differential games in [21], 
and it is the basis of the new approach to discontinuous stabilization proposed in [7], to 
which we now turn. 

3.1 Limits of High- Frequency Sampling 

By a sampling schedule or partition vr = {ti}i>o °^ [^' +°°) '^^ mean an infinite sequence 

= to < *i < *2 < • • • 

with limj^oo ti = oo. We call 

d(7r) := sup(tj+i - ti) 
j>0 

the diameter of vr. Suppose that A; is a given feedback law for system (1). For each tt, the 
TT-trajectory starting from x° of system (3) is defined recursively on the intervals [ti,tj+i), 
i = 0, 1, . . ., as follows. On each interval [tjjtj+i), the initial state is measured, the control 
value Ui = k{x{ti)) is computed, and the constant control u = Ui is applied until time tj+i; 
the process is then iterated. That is, we start with x{to) = x^ and solve recursively 

±{t) = f{x{t), k{x{ti))) , t G [ti, ti+i) , i = 0, 1, 2, . . . 

using as initial value x(tj) the endpoint of the solution on the preceding interval. The ensuing 
vr-trajectory, which we denote as x-,j{-,x'^), is defined on some maximal nontrivial interval; it 
may fail to exist on the entire interval [0, -|-oo) due to a blow-up on one of the subintervals 
[ti,ti+i). We say that it is well defined if X7r(t,x") is defined on all of [0, +oo). 

Definition. The feedback k : M" -^ It stabilizes the system (1) if there exists a function 
P G ICC so that the following property holds: For each 

< e < i^ 

there exists a, 5 = 5{e, K) > such that, for every sampling schedule vr with d(7r) < 5, and 
for each initial state x" with |a;''| < K, the corresponding vr-trajectory of (3) is well-defined 
and satisfies 

\x^{t,x°)\ < maii{P{K,t) ,e} Vt>0. (9) 

In particular, we have 

|x^(t,x")| < max{/3(|x"|,t) , e} Vt>0 (10) 

whenever < e < |x''| and d(7r) < 6{e, |x"|) (just take K := \x°\). 
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Observe that the role of 6 is to specify a lower bound on intersampling times. Roughly, 
one is requiring that 

ti+i < ti + 9{\x{ti)\) 

for each i, where 6 is an appropriate positive function. 

Our definition of stabilization is physically meaningful, and is very natural in the context 
of sampled-data (computer control) systems. It says in essence that a feedback k stabilizes 
the system if it drives all states asymptotically to the origin and with small overshoot when 
using any fast enough sampling schedule. A high enough sampling frequency is generally 
required when close to the origin, in order to guarantee small displacements, and also at 
infinity, so as to preclude large excursions or even blow-ups in finite time. This is the reason 
for making S depend on e and K. 

This concept of stabilization can be reinterpreted in various ways. One is as follows. Pick 
any initial state x°, and consider any sequence of sampling schedules tt^ whose diameters d(7r^) 
converge to zero as ^ ^ oo (for instance, constant sampling rates with ti = i/i, i = 0, 1, 2, . . .). 
Note that the functions xe := a;7r^(-,x°) remain in a bounded set, namely the ball of radius 
/3(|a;°|,0) (at least for i large enough, for instance, any i so that d(7r£) < 5(|x°| /2, |x"|)). 
Because f{x, k(x)) is bounded on this ball, these functions are equicontinuous, and (Arzela- 
Ascoli's Theorem) we may take a subsequence, which we denote again as {x^}, so that 
rc^ ^ a; as ^ ^ cxD (uniformly on compact time intervals) for some absolutely continuous (even 
Lipschitz) function x : [0, oo) -^ M". We may think of any limit function x{-) that arises in 
this fashion as a generalized solution of the closed-loop equation (3). That is, generalized 
solutions are the limits of trajectories arising from arbitrarily high-frequency sampling when 
using the feedback law u = k{x). Generalized solutions, for a given initial state x", may not 
be unique - just as may happen with continuous but non-Lipschitz feedback - but there is 
always existence, and, moreover, for any generalized solution, |x(t)| < /^dx"! ,t) for all t > 0. 
This is precisely the defining estimate for the GAS property. Moreover, if k happens to be 
regular, then the unique solution of x = f{x,k{x)) in the classical sense is also the unique 
generalized solution, so we have a reasonable extension of the concept of solution. (This type 
of interpretation is somewhat analogous, at least in spirit, to the way in which "relaxed" 
controls are interpreted in optimal trajectory calculations, namely through high-frequency 
switching of approximating regular controls.) 

Remark. The definition of stabilization was given in [7] in a slightly different form. It was 
required there that there exist for each i? > a number M{R) > 0, with liuiji\oM{R) = 0, 
and, for each < r < i?, numbers 5o(r, i?) > and T{r,R) > 0, such that the following 
property holds: for each sampling schedule vr with d(7r) < 6Q{r,R), each x° with |x"| < R, 
and each t > T{r,R), it holds that |x^(t, x")] < r, and, in addition, |x7r(t,x")| < M{R) for 
all t > 0. This definition is equivalent to the definition that we gave, based on an estimate 
of the type (9). See Section 5.1 for a proof. 

3.2 Stabilizing Feedbacks Exist 

In the paper [7], the following result was proven by Clarke, Ledyaev, Subbotin, and the 
author: 

Theorem C The system (1) admits a stabilizing feedback if and only if it is asymptotically 
controllable. 
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Necessity is clear. The sufficiency statement is proved by construction of k, and is based 
on the following ingredients: 

• Existence of a nonsmooth control-Lyapunov function V. 

• Regularization on shells of V. 

• Pointwise minimization of a Hamiltonian for the regularized V 

In order to sketch this construction, we start by quickly reviewing a basic concept from 
nonsmooth analysis. 

Proximal Subgradients 

Let V be any continuous function M" -^ R (or even, just lower semicontinuous and with 
extended real values). A proximal subgradient of V at the point x G M" is any vector (, G M" 
such that, for some o" > and some neighborhood O of x, 

V{y) > V{x) + (-{y-x) - a^ly-xl"^ ^y e O . 

In other words, proximal subgradients are the possible gradients of supporting quadratics at 
the point x. The set of all proximal subgradients at x is denoted dpV{x). For example (see 
Figure 13), the function V{x) = \x\ admits any ( G [—1, 1] as a proximal subgradient at 





Figure 13: ^p |x| (0) = [-1, 1] dp{- |x|)(0) = 

X = (elsewhere, dpV{x) = {W{x)}), while for V{x) = — \x\ we have dpV{0) = (because 
there are no possible quadrics that fit inside the graph and touch the corner). 

Nonsmooth Control-Lyapunov Functions 

A continuous (but not necessarily differentiable) V : M" -^ IR>o is a control-Lyapunov func- 
tion (elf) if it is proper, positive definite, and infinitesimally decreasing in the following 
generalized sense: there exist a positive definite continuous W : M" -^ IR>o and a cr G AA so 
that 

sup max min (^ ■ f{x,u) + W{x) < 0. (11) 

xGK" (^dpVix) |u|<o-(|a;|) 

This is the obvious generalization of the differentiable case in (8); we are still asking that 
one should be able to make W{x) ■ f{x,u) < by an appropriate choice of n = Ux, for 
each X 7^ 0, except that now we replace 'W{x) by the proximal subgradient set dpV{x). 
An equivalent property is to ask that F be a viscosity supersolution of the corresponding 
Hamilton- Jacobi-Bellman equation. 

In the paper [34], the following result was proven by the author: 
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Theorem D The system (1) is asymptotically controllable if and only if it admits a contin- 
uous elf. 

Not surprisingly, the proof is based on first constructing an appropriate W, and then let- 
ting V be the optimal cost (Bellman function) for the problem min L W{x{s)) ds. However, 
some care has to be taken to insure that V is continuous, and the cost has to be adjusted 
in order to deal with possibly unbounded minimizers. Actually, to be precise, the result 
as stated here is really a restatement (cf. [40], [7]) of the main theorem given in [34]. See 
Section 5.2 for the details of this reduction. 

Regularization 

Once V is known to exist, the next step in the construction of a stabilizing feedback is to 
obtain Lipschitz approximations of V. For this purpose, one considers the losida-Moreau 
inf-convolution of V with a quadratic function: 



VJx) 



inf 



V{y) + ^\y 



where the number a > is picked constant on appropriate regions. One has that Va{x) /" 
V{x), uniformly on compacts. Since V^ is locally Lipschitz, Rademacher's Theorem insures 
that Va is differentiable almost everywhere. The feedback k is then made equal to a pointwise 
minimizer ka of the Hamiltonian, at the points of differentiability (compare with (6) for the 
case of differentiable V) : 

ka{x) := argmin Wa{x) ■ f{x,u) , 

where a and the compact Uq = Vio{a) are chosen constant on certain compacts and this 
choice is made in between level curves, see Figure 14. The critical fact is that Va is itself a 




Vr,=C 



Figure 14: k = ka on {x \ Va{x) < c, Va'ix) > c'} 

elf for the original system, at least when restricted to the region where it is needed. More 
precisely, on each shell of the form 

C = {x£W\r<\x\<R}, 

there are positive numbers m and ao a-nd a compact subset Uq such that, for each < a < qq, 
each x £ C, and every ( G dpVa{x), 

min ( ■ f{x, u) + m < . 
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See Section 5.3. 

Actually, this description is oversimplified, and the proof is a bit more delicate. One must 
define, on appropriate compact sets 

k{x) := argmin (aix) ■ f{x,u) , 

where Ca{x) is carefully chosen. At points x of nondifferentiability, Ca{x) is not a proximal 
subgradient of Va, since 9pV^(a;) may well be empty. One uses, instead, the fact that Caix) 
happens to be in d^V{x') for some x' ^ x. 

An Example 

As a simple example, we consider the system that was obtained from the two-dimensional 
reduction of the "shopping cart" problem, cf. Figure 12. For this example, continuous stabi- 
lization is not possible, and so no differentiable elf's can exist. On the other hand, the system 
is AC, so one can stabilize it using the techniques just described. A elf for this problem was 
obtained in [25]: 



y(xi,X2) 



X'-' —I— 'y^ 
1 '^ 2 



y^xf +xl + \xi\ 
(0 if xi = X2 = 0) and its level sets are as shown in Figure 15. Note that the nonsmoothness 



Figure 15: Clf Level Sets for system in Figure 12 

happens exactly on the X2 axis (one has an empty subgradient at those points), and the clf 
inequality follows from the fact that 

inf Vy(xi,X2) • /((xi,X2),n) < --{xj + xl) 
u Z 

at points with xi 7^ (the proximal subgradient set is empty otherwise). The stabilizing 
feedback that results is the obvious one: if to the right of the X2 axis, move clockwise, if to 
the left counterclockwise, and make an arbitrary decision (this arbitrariness corresponds to 
the choice of "Ca(x)" in the theory) on the X2-axis. 

4 Sensitivity to Small Measurement Errors 

We have seen that every asymptotically controllable system admits a feedback stabilizer k, 
generally discontinuous, which renders the closed-loop system x = f{x,k{x)) GAS. On the 
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other hand, one of the main reasons for using feedback is to deal with uncertainty, and 
one possible source of uncertainty are measurement errors in state estimation. The use of 
discontinuous feedback means that undesirable behavior -chattering- may arise. In fact, one 
of the main reasons for the focus on continuous feedback is precisely in order to avoid such 
behaviors. Thus, we turn now to an analysis of the effect of measurement errors. 

Suppose first that A; is a continuous function of x. Then, if the error e is small, using 
the control u' = k{x + e) instead oi u = k{x) results in behavior which remains close to the 
intended one, since k{x + e) ~ k{x)] moreover, if e ^ x then stability is preserved. This 
property of robustness to small errors when k is continuous can be rigorously established by 
means of a Lyapunov proof, based on the observation that, if y is a Lyapunov function for 
the closed-loop system, then continuity of /(x, k{x + e)) on e means that 

W{x)- f{x,k{x + e)) « W{x)- f{x,k{x)) < 0. 

Unfortunately, when k is not continuous, this argument breaks down. However, it can be 
modified so as to avoid invoking continuity of k. Assuming that V is continuously differen- 
tiable, one can argue that 

VV{x)- f{x,k{x + e))^VV{x + e)- f{x,k{x + e)) < 

(using the Lyapunov property at the point x + e instead of at x). This observation leads to a 
theorem, formulated below, which says that a discontinuous feedback stabilizer, robust with 
respect to small observation errors, can be found provided that there is a C^ elf. 

In general, as there are no C^, but only continuous, elf's, one may not be able to find any 
feedback law that is robust in this sense. We can see this fact intuitively with an example. Let 
us take once more the two-dimensional problem illustrated in Figure 12, and let us suppose 
that we are using the following control law: if to the right of, or exactly on, the x-2 axis, 
move clockwise, and if to the left move counterclockwise. See Figure 16, which indicates 
what happens on any circle. The main point that we wish to make is that this feedback law 




Figure 16: Feedback A; on a typical integral manifold 

is extremely sensitive to measurement errors. Indeed, if the true state x is slightly to the 
left of the top point, but we mistakenly believe it to be to the right, we use a clockwise 
motion, in effect bringing the state towards the top, instead of downwards towards the target 
(the origin); see Figure 17. It is clear that, if we are unlucky enough to consistently make 



Figure 17: True state; measured state; erroneous motion commanded 
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measurement errors that place us on the opposite side of the true state, the resuh may well 
be an oscillation (chattering) around the top. 

We might say, then, that the discontinuous feedback laws which are guaranteed to always 
exist by the general theorem in [7] lead to fussy control* -not to be confused, of course, with 
"fuzzy" control. 

There are many well-known techniques for avoiding chattering, and a very common one 
is the introduction of deadzones where no action is taken. Indeed, in the above example, one 
may adopt the following modified control strategy: stay in the chosen direction (even if it 
might be "wrong" ) for some minimal time, until we are guaranteed to be far enough from the 
discontinuity; only after this minimal amount of time, we sample again. At this point, we 
know for sure on which side of the top we are. (This assumes that we have an upper bound 
on the magnitude of the error. Also, of course, observation errors when close to the origin 
will mean that we can only expect "practical" stability, meaning that we cannot be assured 
of convergence to the origin, but merely of convergence to a neighborhood of the origin whose 
size depends on the size of the observation errors.) 

Such a control strategy is not a pure "continuous time" one, in that a minimum inter- 
sample time is required. It can be interpreted, rather, as constructing a hybrid (different 
time scales needed) and dynamic (requiring memory) controller. The paper [26] proves a 
general result showing the possibility of stabilization of every AC system, using an appropri- 
ate definition of general hybrid dynamic controllers. The controller given there incorporates 
an internal model of system. It compares, at appropriate sampling times, the state pre- 
dicted by the internal model with the -noisy- observations of the state; whenever these differ 
substantially, a "reseting" is performed in the state of the controller. 

Actually, already the feedback constructed in [7], with no modifications needed, can always 
be used in a manner robust with respect to small observation errors, using the idea illustrated 
with the circle of not sampling again for some minimal period. Roughly speaking, the general 
idea is as follows. 

Suppose that the true current state, let us say at time t = ti, is x, but that the controller 
uses u = k{x), where x = x + e, and e is small. Call x' the state that results at the next 
sampling time, t = tj+i. By continuity of solutions on initial conditions, |x' — x'| is also 
small, where x' is the state that would have resulted from applying the control u if the true 
state had been x. By continuity, it follows that Va{x) ~ Kt(x) and also Va{x') ~ V^(x'). On 
the other hand, the construction in [7] provides that Vaix') < Va{x) — (i(tj+i — ti), where 
d is some positive constant (this is valid while we are far from the origin). Hence, if e is 
sufficiently small compared to the intersample time tj+i — ti, it will necessarily be the case 
that Va{x') must also be smaller than Va{x). See Figure 18. Thinking of V^ as a Lyapunov 
function, this means that x' is made "smaller", even if the wrong control u = k{x), rather 
than k{x), is applied. 

This discussion may be formalized in several ways. We limit ourselves here to a theorem 
assuring semiglobal practical stability (i.e., driving all states in a given compact set of initial 
conditions into a specified neighborhood of zero). For any sampling schedule tt, we denote 

d(7r) := inf (tj+i - ti) . 

If e : [0, oo) -^ M"" is any function (e(t) is to be thought of as the state estimation error at 
*Fussy (adjective): ". . . requiring . . . close attention to details" (Webster). 
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X = x+ error 



V,, = c 




c' 



:C' 



Figure 18: tj+i > tj =^ c' <.c => d < c 

time t), A; is a feedback law, x" G M", and vr is a sampling schedule, we define the solution of 

X = f{x,k{x + e)), x(0)=a;" (12) 

as earlier, namely, recursively solving 

x{t) = f{x{t),k{x{ti)+e{ti))) 

with initial condition x{ti) on the intervals [tj,tj+i]. The feedback stabilizer that was con- 
structed in [7] was defined by patching together feedback laws, denoted there as ky (where 
V = (a,r,R) is a triple of positive numbers, with r < R). We use these same feedbacks in 
the statement of the result. 

Theorem E Suppose that the system (1) is asymptotically controllable. Then, there exists 
a function T G /Coo with the following property. For each < e < K , there is a feedback of 
the type ky, and there exist positive 6 = 5{e,K), k = K{e,K), and T = T{e,K), such that, 
for each sampling schedule vr with d(7r) < 6, each e : [0, cx)) -^ R" so that 

\e{t)\ < Kd(7r) Vt > 0, 

and each x° with |x"| < K, the solution of the noisy system (12) satisfies 

\x{t)\ < r{K) vt> 

and 

\x{t)\ < e Vt >r. 

See Section 5.4. 

4.1 A Necessary Condition 

Theorem E insures that stabilization is possible if we sample "just right" (not too slow, so as 
to preserve stability, but also not too fast, so that observation errors do not cause chattering). 
It leaves open the theoretical question of precisely under what conditions is it possible to find 
a state feedback law which is robust with respect to small observation errors and which, on 
the other hand, is a continuous-time feedback, in the sense of arbitrarily fast sampling. The 
discussion preceding Theorem E suggests that this objective cannot always be met (e.g., for 
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the circle problem), but that the existence of a C^ elf might be sufficient for guaranteeing 
that it can. Indeed, this is what happens, as was proved in the recent paper [27]. We next 
present the main result from that paper. 
We consider systems 

x{t) = f{x{t),k{x{t) + e{t))+d{t)) (13) 

in which there are observation errors as well as, now, possible actuator errors d{-). (Actually, 
robustness to just small actuator errors is not a serious issue; the original paper [7] showed 
that the feedback laws obtained there stabilize even in the presence of such errors, or even 
model errors.) We assume that actuator errors d{-) : [0, cx)) -^ U are Lebesgue measurable 
and locally essentially bounded, and that observation errors e(-) : [0, oo) -^ M" are locally 
bounded. 

We wish to define what it means for a feedback k to stabilize (13); roughly, we will ask 
that, for some /? G ICC, and for some "tolerance" function 6 : M>o -^ M>0) we have an 
estimate \x{t,x°)\ < /3(|x°|,t) provided that |e(t)| < 0{\x{t)\) and~\d{t)\ < 0{\x{t)\) for ah 
t (small enough errors). However, the definition is somewhat complicated by the need to 
appropriately choose sampling frequencies. 

We define solutions of (13), for each sampling schedule tt, in the usual manner, i.e., solving 
recursively on the intervals [ti, tj+i), i = 0, 1, . . ., the differential equation 

x(t) = fixit) , kixiU) + eiti)) + dit)) (14) 

with x(0) = x". We write x{t) = XT^{t, x", d, e) for the solution, and say it is well-defined if it 
is defined for all t > 0. 

Definition. The feedback k : M" -^ It stabilizes the system (13) if there exists a function 
(3 G K.C so that the following property holds: For each 

Q < e < K 

there exist 6 = (5(£, K) > and r] = r]{e, K) such that, for every sampling schedule vr with 
d(7r) < 5, each initial state x° with |x°| < K, and each e,d such that |e(t)| < r] for all t > 
and \d{t)\ < rj for almost all t > 0, the corresponding -/r-trajectory of (13) is well-defined and 
satisfies 

|x^(t,x°,d,e)| < max{/3(K,t) , e} Vt>0. (15) 

In particular, taking K := |x"|, one has that 

\x^{t,x\d,e)\ < max{/3(|x"| ,t) , e} Vt > 

whenever < e < jx"!, d(7r) < 5{e, jx"!), and for all t, \e{t)\ < r]{e, jx"]), and \d{t)\ < r]{e, jx"!). 
The main result in [27] is as follows. 

Theorem F There is a feedback which stabilizes the system (13) if and only if there is a C^ 
elf for the unperturbed system (1). 

This result is somewhat analogous to a result obtained, for classical solutions, by Hermes 
in [14]; see also [13]. 
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It is interesting to note that, as a corollary of Artstein's Theorem, for control-affine 
systems x = go{x) + Yl'^iQii^) we may conclude that if there is a discontinuous feedback 
stabilizer that is robust with respect to small noise, then there is also a regular one, and even 
one that is smooth on M" \ {0}. 

For non control-affine systems, however, there may exist a discontinuous feedback stabi- 
lizer that is robust with respect to small noise, yet there is no regular feedback. For example, 
consider the following system with n = 3 and m = V. 

ii = U2U3 
±2 = U1U3 
is = U1U2 ■ 

Here, there is a C^ elf, namely the squared norm (xi + X2 + x'^), but there is no possible regular 
feedback stabilizer, since Brockett's condition fails because points (0,7^ 0,7^ 0) cannot be in 
the image of (x, u) ^^ f{x, u). (Because this is a homogeneous system with no drift, Brockett's 
condition rules out even feedbacks that are not continuous at the origin, see [27] for a remark 
to that effect.) 

The sufficiency part of Theorem F proceeds by taking a pointwise minimization of the 
Hamiltonian, for a given C^ elf, i.e. k{x) is defined as any u with |u| < o"(|x|) which minimizes 
Vy(x) • f{x,u). The necessity part is based on the following technical fact: if the perturbed 
system can be stabilized, then the differential inclusion 

X £ F{x) := f^Wf{x,k{x + eB)) 

£>0 

(where B denotes the unit ball in M") is strongly asymptotically stable. One may then ap- 
ply the recent converse Lyapunov theorem of [5] for upper semicontinuous compact convex 
differential inclusions (which generalized to differential inclusions the theorem from [28] char- 
acterizing uniform asymptotic stability of systems with disturbances x = f{x,d)) to deduce 
the existence of V. 

We can now summarize exactly which implications hold. We write "robust" to mean 
stabilization of the system subject to observation and actuator noise: 

C^ V ^=> 3 robust k 

C^V ^^ 3 k ^^ AC 

Remark. The definition of stabilization of (13) was given in [27] in a slightly different form 
than here. There, it was required that for each < r < i? there exist M = M{R) > with 
liuiji\Q M{R) = 0, 5 = 5{r,R) > 0, T = T{r,R) > 0, and t] = ri{r,R), such that, for every 
partition vr with d(7r) < 6, each initial state with |a;"| < R, and each e, d such that |e(t)| < 77 
for all t > and \d{t)\ < rj for almost all t > 0, the vr-trajectory of 

X = f{x, k{x + e) + d) 

is defined for all t > and 

|x(t)| < r Vt > T and |2;(t)| < M(i?) Vi > . 

This definition is equivalent to the definition that we just gave. The same proof as in Sec- 
tion 5.1 applies. 
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5 Some Proofs 

We fill-in here the proofs of several technical points regarding stabilization. 

5.1 Estimates for Stabilization 

We prove here that if a feedback k stabilizes in the sense of the definition of stabilization 
given in [7], then it is also stabilizing in the sense of the definition given here, by means 
of an estimate of the type (9). (The converse implication is obvious.) Suppose M{R) > 0, 
So{r, R) > 0, and T{r, R) > 0, are such that lim^^^o M{R) = 0, and whenever d(7r) < (5o(r, R) 
and Ix"! < i?, necessarily |x7r(t,x")| < M{R) for all t > and |x7r(t, x")] < r for all t > T{r, R). 
We first define 6 = 5(e, R) > 0, for each < e < i?, as follows: pick the smallest positive 
integer k (necessarily > 2) such that -^ < e, and let 

S{e,R) := mml6oi—,R] , ... ,6o(j,R 

Next, we define a function 

ip:R>oX M>o -^ R>o 

as follows. Pick any R > and any t > 0. Let < ti < t2 < • • • be a sequence of real 
numbers (depending on R) so that ti ^ oo as i ^ oo and such that 

ti > t(-^,r] , i = l,2,... . 

Now define ip{R,t) := M{R) for t G [0,ti) and (^(i?,t) := ^^ if t G [tuU+i) for some i > 1. 

We claim now: for each < e < i?, each |a;"| < R, each t > 0, and each sampling schedule 
such that d(7r) < 5{e,R), 

|x7r(t, x°)| < max{(^(i?, t), e} . 

Pick any such e,R,x'^,TT. Define the sequence {ti} as above, for this R. Let k be the 
smallest positive integer such that ^ < e. By definition of 6, 6{e,R) < 6o{R/j,R) for all 
j = 2,...,k. We consider three cases: (i) t < ti, (ii) t G [ti,tk-i), and (iii) t > tfc-i- 
In the first case, we know that \x.j^{t,x°)\ < M{R) = (p(R,t). In the last case, we know 
that |x7r(i,x")| < e, because d(7r) < 6o{R/k,R) implies that |x7r(i,x")| < R/k < e for 
all t > T(R/k,R), and t^-i > T{R/k,R) by definition of the tj's. In case (ii), we have 
that there is some j £ {2, . . . , A; — 1} so that t G [tj-i,tj). Since tj-i > T{R/j,R) and 
d(7r) < 6o{R/j,R), \xT^{t,x°)\ < R/j = ip{R,t). The claim is then established. 

It only remains to show that there is some function (3 G ICC so that (p(s, t) < (3{s, t) for 
all s, t. The constructions given in the first section of [28] show that there exists such a (3, 
provided that the following properties hold for (p: 

1. For some 7 G /Coo, sup ip{R, t) < ^(R) for all R > 0. 

00 

2. For each e > and each R > there is some T{e, R) such that 

t>T{e,R) => ^{R,t) <e. 
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The first property is satisfied because M could, witfiout loss of generality, be taken to be of 
class /Coo (if necessary, first use a step function M; then majorize it by a /Cqo function). The 
second property holds as well: take without loss of generality e < R, then pick a positive 
integer k minimal with R/k < e, let the sequence {tj} be as in the construction of f, and define 
T{e,R) := tfe_i. Observe that t > tfc_i implies, by definition of f, that ip{R,t) < R/k < e, 
as wanted. 

5.2 Proximal Form of elf Theorem 

We fill-in the details here to show how the proximal subgradient form of the continuous elf 
existence Theorem D follows from the result in [34] . Before stating the original form of the 
result, we recall the notion of relaxed control. For each real s > 0, let us denote by It^ the 
radius-s ball in U = M™. A relaxed Mg-valued control is a measurable map uj : I ^ F{Us), 
where I is an interval containing zero and P(Us) denotes the set of all Borel probability 
measures on lis- Note that ordinary controls can be seen also as relaxed controls, via the 
natural embedding of Us into P(Us) (map any point u £ Us into the Dirac delta measure 
supported at u). Given any /x G PCUs), we write J^ f{x,u) dfi{u) simply as f{x,^). As with 
ordinary controls, we also denote by x(t,x°,a;) the solution of the initial value problem that 
obtains from initial state x" and relaxed control uj, and we consider the supremum norm \\io\\, 
defined as the infimum of the set of s such that ijo{t) G P(Us) for almost all t £ I. 

The main result in [34] says that if (and only if) a system is AC, there exist two continuous, 
positive definite functions V, W : M" -^ M, with V proper, and a nondecreasing function 
a : ]R>o -^ IR>0) so that the following property holds: for each x° £ M" there are a T > 
and a relaxed control uj : [0,T) -^ ¥(lif^n^ov\), so that x{t) := x{t,x^\uj) is defined for all 
< t < T and 



v{x{t)) - y (x") <- [ w{x{t)) dT yt£ [0, T) . 

Jo 



(16) 



To simplify notations, let us write s := cj(|x"|). In order to obtain the proximal version of 
the result, we show that 

mm C- f{x'\u) < -W{x") (17) 

\u\<s 

for all C G 3pF(x«). 

As in [40], we first make an intermediate reduction, showing that 

min DV{x'';v) < -W{x") , (18) 

where F(x",s) denotes the (closed) convex hull of {f{x°,u),u £ Us}, and DV{x^';v) is the 
directional subderivate, or contingent epiderivative, of V in the direction of v at x°, defined 
as 

DV{x'';v) := liminf -[V{x" + tv') -V{x°)] . 
t\0 t 

v' ^ V 

(The minimum in (18) is achieved, because the map v h^ DV{x'^;v) is lower semicontinuous, 

see e.g. [6], ex.3.4.1e.) So, let x{t) = x{t,x'^,u;) be as above, and consider for each t £ [0, T) 

the vectors 

1 1 /"* 

n ■■= -(x(t)-x°) = - / f{x{T),Uj{T))dT = qt+Pt, 
^ ^ JO 
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with 

where gt ^ as t\0 (the existence of such a g^, for each t, is an easy consequence of the 
fact that / is locaUy Lipschitz on x, uniformly on n G Its). Moreover, pt G F(x",s) for all 
t (because F(x",s) is convex, so /(x",a;(r)) G F(x'',s) for each r, and then using convexity 
once more). By compactness, we have that there is some v G F{x", s) and some subsequence 
Ptj -^ V with tj \0; as qt -^ 0, also Vj := rt^ -^ v. For this v, 

DV{x°;v) < limmf-[V{x° + tjVj)-V{x°)] 

= limmi-[V{x{tj))-V{x'')] < -W{x'') 

j-^OO tj 

(using (16)), so (18) indeed holds. 

Finally, we show that (18) implies (17). Let v G F{x°,s) achieve the minimum, and pick 
any ^ G dpV{x°). By definition of proximal subgradient, there is some /i > so that, for 
each v' G F{x°, s) and each small t >0, 

C-v' < -[Vix" + tv') - Vix")] + fit\v'\'^ 

so taking limits along any sequence t \ and v' ^ v shows that C " ^ ^ DV{x°;v) < — H^(x"). 
By definition of F{x°, s), this means that there must exist a m G IXq so that also ( • f{x°,u) < 
—W{x°), as desired. 

Observe that the proximal condition (17), being linear on the velocities f{x,u), has the 
great advantage of not requiring convex hulls in order to state, and in that sense is far more 
elegant than (18). 

5.3 Va is a (Local) elf 

We prove here that, on each set Cr,R = {x G M" | t' < |x| < R}, there is an ao{r, R) > such 
that, for each positive a < ao{r,R), the (locally Lipschitz) function Va behaves like a elf on 
the set Cr,R- In order to simplify referencing, we write "([7]n)" to refer to Equation (n) in [7] 
and do not redefine notations given there. Let IXq be a compact subset so that min„gxxQ C • 
f{x,u) < —W{x) for every ( G dpV{x) and every x in the ball of radius R + y^2(3{R). Let 
"T-r,R := |min{W^(x) | x G Crfi}, and let £ be so that \f{x,u) — f{x',u)\ < £\x — x'\ for all 
M G Ito and all x in the ball of radius R + ■\j2j3{R). (This is almost as in ( [7] 29) , except 
that, there, I was a Lipschitz constant only with respect to |x| < R.) Finally, as in [7], lor (•) 
denotes the modulus of continuity of V on the ball of radius R + yj2f3{R). 

Proposition. Let a G (0, 1] satisfy 21ujr ia^j2[3{R)\ < nir^R. Then, for all x G Cr,R and 
aU C G dpVa{x), 

minC ■ f{x,u) < -nir^R. 

Proof. We start by remarking that, for all a G (0, 1] and all x G Br, 

|ya(x)-x|2 < 20" URiay/WiR)) ■ (19) 
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This follows from (cf. ([7] 19)): 

1 2 

-^\ya{x)-x\ < V{x) -V{ya{x)) < ujR {\ya{x) - x\) 



and using that \yaix) — a;| < ay^2f3{R) (cf. Lemma III. 3 in [7]) plus the fact that lor (•) is 
nondecreasing. So 



|2 
— X 

and hence 



\Ca{x)\-\ya{x)-x\ = '^"^^^2 '"' ^ 2coR{^a./mR)) 



Caix) ■[f{yaix),u) - f{x,u)] < i\Ca{x)\ ■ \yaix) - x\ < 2iu;n[a 
for all u £ Uo and all x € Br, because ya{x) G ^n , / 2rir\ (*^f- (['''l^O))- Thus, 

Ca(x)-/(x,u) < CaW-/(2/a(x),n) + 2^u;r (a^2[3{R)) ■ 

For each x G Cr.,_R, we have that ya{x) G -^di / 23(B) ^^^ ^^^' (t''']-'-^)) Ca(^) ^ f^P^(yQ(2^))) so 
we can pick a u^: G Uq so that Caix) ■ f{ya{x),Ux) < —W{x) < —2mr^R. Using now the fact 



that 2£ojR ( ay 2/3(i?) J < rrir^R, we conclude that 

Ca{x) ■ f{x,u) < -nir^R. 

So we only need to prove that dpVaix) C {Caix)} for all x. This is given in [6], Theorem 
l.'S.l, but is easy to prove directly: pick any ( G (9pV^(x); by definition, this means that 
exists some o" > such that, for all y near x, ( • (y — x) < Va{y) — Va{x) + a \y — x\ , so 

C-iy-x) < Va{y) - Va{x) + 7 (|y - x\) (20) 

for some j{r) = o{r). Adding 

1 2 

-Ca{x)-{y-x) < -Va{y) + Va{x) + —^ \y - x\ 

(cf. ([7] 13)), we conclude 

iC - Caix)) ■ (y - x) < o{\y-x\). 

Substituting y = x + h{C, — C,a{x)) and letting /i\ shows that C, = C,a{x)- (Observe that we 
have proved more that claimed: Equation (20) is satisfied by any viscosity subgradient Q; in 
particular, the gradient of V , if V happens to be differentiable at the point x, must coincide 
with C,a{x)-) I 

Observe that the feedback constructed in [7] was k{x) = any n G Uq minimizing C,a{x) ■ 
f{x, u) (where a and Uq are chosen constant on certain compacts). As Va is locally Lipschitz, 
it is differentiable almost everywhere. Thus, the Proposition (see the end of the proof) insures 
that Caix) = VV^(x) for almost all x. So /c(x) = u is, at those points, the pointwise minimizer 
of the Hamiltonian VV^(x) • fix,u) associated to the regularized elf Va- 
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5.4 Proof of Theorem E 

We will prove the following more precise result. All undefined notations, including the defi- 
nitions of the functions 7 and p, can be found in [7]. 

Theorem G Pick any < r < R so that 2^(r) < "y{R). Then there exist positive numbers 
a, 6, K, T such that, for each partition it with d(7r) < 6, and each e : [0, 00) -^ M" which 
satisfies \e{t)\ < Kd(7r) for all t, the following property holds: if x{-) satisfies 

x = f{x,kix + e)), |x(0)| <lpiR), (21) 

where k is the feedback ka,r,R, then 

x{t) £ Br Vt > (22) 

and 

x{t) £ Br yt>T. (23) 

Theorem E is a corollary: we first pick any T such that s < (l/2)p(r(s)) for all s > 0. 
Then, given e and K, we can let R := T(K) (so, K < (l/2)p(i?)), we then take any < r < e 
such that 2^{r) < ^{R), and apply the above result to < r < i?. 

We prove Theorem G through a series of technical steps. Let < r < R he given, with 
2'j{r) < 7(-R). In order to simplify referencing, we write "([7]n)" to refer to Equation (n) in 

[7]. 

We start by picking a as any positive number which satisfies ([7]23), ([7]30), and, also, 
instead of ([7]40), the slightly stronger condition 

iVR [V2ma) < ^7(0 . (24) 

The function Va is defined as in ([7]9); because of ([7]13), ([7]11), and ([7]19), the number 



c := \ 5- 

a a^ 

is a Lipschitz constant for Va on the set Br. Without loss of generality, we assume c > 2. 
We let 1X0 be as in [7], and take the feedback k = ka,r,R- The numbers i, m, and A are as in 
([7] 29) and the equation that follows it. 

Next, we pick any eo > so that all the following - somewhat redundant - properties 
hold: 

i?ip(R)+eoi? ^ Gg (25) 

(this is possible because -Bp(_R) ^ G^ by ([7] 22)), 

C^R + 2eoB C Br (26) 

(possible because G^ C int^R by ([7]24)), 

^ . 7(r) 7(r) .■.7^ 
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7(r) + ceo < h(^) (28) 

(recall that 2^{r) < 7(i?)), and 

G° + 2eoB C G% . (29) 

We let 5q be any positive number so that, for every initial state x" in the compact set G^, 
and for each control u : [0, 5o] -^ Uq, the solution of x = f{x, u) with x(0) = x" is defined on 
the entire interval [0,So] and satisfies x{t) G G^ + EqB for all t. 

Finally, we pick any 6 > which satisfies ([7]33), ([7]41), as well as 

5 <mm\l,6o,^eo,^] , (30) 

[ A 8cm J 

and we let 

K := ^e'' (31) 

4c 

and 

T := ^ (32) 

(this is twice the value used in ([7] 39)). 

The main technical fact needed is as follows. 

Proposition 5.4.1 Let < r < R satisfy 2j{r) < 'y{R)- Let a,5,K,T be defined as above, 
and k be the feedback ka,r,R- Pick any e > 0, and consider the following set: 

P = Pr,R,e :={x\x + eBC G^} . 

Let IT be a partition which satisfies 

- < ti+i-ti < S Vi = 0, 1,... (33) 

K 

(that is, d(7r) < 6 and e < Kd(7r)j. Then, for any e : [0, oo) -^ M" such that \e{t)\ < e for all 
t, and any x" £ P, the solution of x = f{x, k{x + e)) is defined for all t > 0, it satisfies (22) 
and (23), and x{ti) G P for all i. 

We will prove this via a couple of lemmas, but let us first point out how Theorem G follows 
from Proposition 5.4.1. Suppose given a partition tt with d(7r) < 6, an error function e so that 
\e{t)\ < Kd(7r) for all t, and an initial state x° with |x°| < \p{R). Let e := sup^>o |e(i)| < 
Kd(7r). Note that 

2 4c 

£ < Kd(7r) < Kd(7r) < k.6 < k.—£o < h—c^eq = eo • (34) 

Thus, by (25), 

so x" G P. Therefore, (22) and (23) hold for the solution of x = /(x, k{x + e)), as wanted for 
Theorem G. 

We now prove Proposition 5.4.1. Observe that (33) implies e < Kd(7r), so, arguing as 
in (34), £<£(). It is useful to introduce the following set as well: 

Q = Qr,R,£ '■= C^ + eB . 

Observe that Q C P, by (29). 

We start the proof by establishing an analogue of Lemma IV. 2 in [7]: 
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Lemma 5.4.1 //, for some index i, Xi := x{ti) ^ P \ Q, then x{t) is defined for all t G 

x{t)£BR VtG [ti,ti+i], (36) 

Va{x{t)) < Va{xi)+eo Vt G [U,ti+i] , (37) 

and, letting Xj+i := a:(tj+i); 

Xi+i G P, (38) 

A 

Va{xi+l) - Va{xi) < -- (ti+l - ti) . (39) 

Proof. By definition of P, we have that Xi := Xj + e(tj) G C^. Also, Xj ^ G", since otherwise 
Xi would belong to Q. In particular, Xj ^ ^p(r)- Let x(-) be the solution of x = f{x,k{xi)) 
with x(tj) = Xj on [tjjtj+i]. By Lemma IV. 2 in [7], this solution is well-defined and it holds 
that x{ti+i) G G% and Va{x{t)) - Vq(xj) < -A (t - tj) for all t. As Xj G P C G% and 
tj+i — ti< d(7r) < (5 < (Jo, the definition of 5q insures that the solution x(-) of x = /(x, k{xi)) 
with x(tj) = Xj is indeed well-defined, and it stays in G^ + EqB C i?^ for all t. So, by 
Gronwall's inequality, we know that 

\x{t)-x{t)\ < e(*-*')^|xi-Xi| < e^^e 

for all t G [tj,ti+i]. Since Va has Lipschitz constant c on i?/j, we have 

Va{x{t)) - VUx^) 

= Vaix{t)) - Va{x{t)) + Va{x{t)) - Va{x^) + Kv(x,) - K.(x,) 

< ce^^e - A{t-ti) + ce 

< -{ti+i-ti)-A{t-ti) 

for all t G [ti,tj+i], where we have used that 6 < 1, e < Kd{iT), the definition k = (A/4c)e~^, 
and the fact that d(7r) < ti^i — ti. In particular, the estimate (39) results at t = tj+i, and (37) 
holds because (A/2) 5 < Eq by (30). 

We are only left to prove that Xj+i G P. By definition of P, this means that for any given 
rj G M" with |?7| < e it must hold that 

V + Xi+i G G^ = {x I Va{x) < {1/2HR)} . 

Pick such an r/; then jr/ + Xj+i — x(tj+i)| < e + e e < 2e^e, and so, since rj + Xj+i G G^ + 
2eoB C Br, 

Va{ri + Xi+i) < 2ce^e + Va{x{ti+i)) 

< 2ce^£ + Va{ii)-A{ti+i-ti) 

< Vaiii) - ^ {U+l - t^) < -7(i?) 

where we again used e < Kd(7r) as well as the fact that Va{xi) < {1/2)^{R) (since Xj G G^). 

I 

We also need another observation, this one paralleling the proof of Lemma IV. 4 in [7]. 
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Lemma 5.4.2 //, for some index i, Xj := x(tj) G Q, then x{t) is defined for all t £ [tj,tj+i], 

VUxit)) < ^7(0 VtG [t„tm], (40) 

and 

Vixit)) < ^7(r) VtG[t„t,+i]. (41) 

/n particular, x{t) G i?^ /or a// 1 £ [ij,ti+i] and x(tj+i) G P. 

Proof. The fact that x is defined fohows from the choice of Sq, and we know that x(t) G Br 
for all t G [tj,tj+i]- So 

|a;(t) - Xi\ < m6 Vt G [ti,ti+i] . (42) 

By definition of Q, we may write Xj = x' + rj, for some x' G G^ and some |r/| < e. Thus, 
Va{xi) < Va{x') + ceo < ^7('^) + ceo (second inequality by definition of G"). Together 
with (42), this gives 

Va{x{t)) < -7(r) + ceo + cm5 < ^7(0 VtG[ti,ti+i] 
(using (27) and (30)). So, using (24) and ([7]21), 

Vix{t)) < V^ixit)) + UR (TW^I") < l^ir) + ^lir) < ^7(0 

for all t G [ti,tj+i], as wanted. By the definition of 7 (see [7]), this means that x(t) G Br for 
all t G [tj,tj+i]. Finally, if |??| < e then 

K.(x(t,+i) +7?) < ce+ ^7(r) < -j{R) 

(the last inequality by (28)), which means that x(ij+i)+r/ G G^; this implies that x(tj+i) G P. 

I 

Back to the proof of Proposition 5.4.1, since x° G P, Lemmas 5.4.1 and 5.4.2 guarantee 
that the solution exists for all t and remains in Br, and that Xj := x(tj) G P for all i. 

Moreover, if there is some j so that x{tj) G Q, then it holds that V^(xj) < |7(r) for all 
i > j. This is because on intervals in which Xi_i G Q, we already know that Va{x(ti)) < ^j{r), 
and if instead Xj_i £ P\Q, then we have V^(xj) < VI^(xj_i). So, for any such i > j, either 
x{t) G -Br for all t G [ti,ti+i] (first case) or Va{x{t)) < |7(r) + eg for all t G [ti,ti^i] (second 
case). Actually, in this last case we also have 



F(x(t)) < VUxit))+u;R(^/2f3iR)a 



< j7{r)+eo+u;R(^y'2(3{R)a 
3 11 

(using (27) and (24)), so, again by definition of 7, also x(t) G Br for all t G [tj,ti+i]. In 
conclusion, trajectories stay in Br after the first time that x{tj) G Q. So we only need to 
show that there is such a j, with tj < T. 
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Suppose instead that for i = 0, . . . , A; it holds that x(tj) ^ Q, and tk > T. Applying (39) 
repeatedly, 

< Va{x{t,)) < Kv(x») -^tk<^-^T, 

(recall that x" G P implies that x £ G'^), and this contradicts (32). The proof of Proposi- 
tion 5.4.1 is then complete. I 

This completes the proof. We remark that a more global result is also possible, as follows. 
We start by picking two sequences {rj,j G Z} and {Rj,j G Z} such that rj,Rj -^ as j ^ 
— oo, rj,Rj ^ CO as j ^ oo, and 2Rj < p{Rj^i), 2^{rj) < "fiRj), and 2rj < p(i?j_i) for all 
j. Next we pick, for each j, positive numbers aj,6j, Hj-,Tj associated as per Proposition 5.4.1 
to Tj and Rj, and let kj := ka-,r-,R ■ (We may assume that values of kj belong to some fixed 
Ito for all j < 0, and to lij for j > 0, with all the lij compact and forming an increasing 
sequence.) Since Gj, C intG^^,^^ for all j (this is proved just as in ([7]48)), there is some 
sequence of positive numbers {£j,j G Z} so that £j < Kj5j for all j and also, denoting 
Pj := Pr ,R ,e 1 so that Pj C Pj+i for all j. Note that the choice of the r^-'s and Rj's assures 
that \jPj = M"\{0}. Since 2rj < p{Rj^i) for all j, and using (35), we know that B^ Q Pj-i 
for all j. 

Finally, we define the feedback k : M" -^ M™ via: 

k{x) := kj{x) if X G Pj \ Pj-i 



(and k{0) = 0), and let e(x) := Ej, /i(x) := -^, and 6{x) := Sj for x €£ Pj \ Pj-i, for each j 
(let £j{0) = and < m{0) < (5(0) be arbitrary). Observe that, since Ej < Kj6j for all j, it 
holds that /u(x) < 6{x) for all x. 

Now suppose that x" is given, and a partition tt and a function e(-) are given so that, 
recursively along the solution of x = /(x, fc(x + e)), 

fJ-i^iU)) < ti+i -ti < 5{x{ti)) 

and 

e{ti) < E{x{ti)) 

for all i. Note that, if for some i and j, x{ti) G Pj \ Pj-i, then the inequality in (33) holds 
with E = Ej, K = Kj, 5 = 6j, and this i. 

Let j G Z be maximal so that x" G Pj. Then, it will hold that the solution stays in the 
bounded set -Br , and every x(tj) is again in Pj, until the first sampling time ti that x(tj) G Pg 
for some i < j. This first time, say tg, is at most Tj, because B^ ^ Pj-i. If x{tq) = 0, then 
the solution stays there forever (since /(0, 0) = 0). Otherwise, x{tq) G P^ \ P^-i for some 
i < j, and we may repeat the argument. The conclusion is that the trajectory keeps visiting 
smaller sets Pi (or it becomes in finite time), with an upper bound T{i,j) (the sum of the 
corresponding T^'s) on the time required for entering a given Pj, if the initial state x° was in 
a given Pj. Furthermore, given any < r < P, there are i < j so that Pi '^ Br '^ Br C Pj. 
Thus, all trajectories in B^ are taken into Br in a uniform time T{r,R), with bounded 
overshoot (since trajectories stay in Pr ). 
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6 Stability with Respect to Disturbances 

One of the conclusions from the preceding discussion is that, provided that there is a C^ elf, 
the closed-loop system x = f{x, k{x + e) + d) in Equation (13) is "stable" in a certain precisely 
defined sense. If we view the measurement and actuator error functions e and d as external 
inputs to the system, we may write x = g{x,v) to represent this closed-loop system (13), 
where v = {e,d). Interpreted in these terms, the previous discussion dealt with the effect of 
small "inputs" v on the system x = g{x,v). 

In many control problems, on the other hand, one wishes to understand the effect of large 
external inputs. This interest might be due to the need to quantity the effect of large errors 
in measurements or actuators, but there are many other motivations as well. For example, in 
disturbance rejection problems, one may wish to cancel the effect of an input to the system 
(such as wind acting on an aircraft). In tracking problems, a desired path r{t) may be given 
and we might want to make the tracking error x{t) — r(t) ^ as t ^ oo, which can be 
interpreted loosely as the stabilization of the signal x — r. (More generally, we may want 
a subset of the coordinates, or even an arbitrary function of the state, to follow a desired 
behavior; see [36] for a discussion of some tracking problems.) We are thus led to the study 
of the general question: how does the state trajectory x{t) = x{t, x°,u) depend on u and x°? 
More precisely, we would like to compare the global behavior of x and u, asking questions 
such as: does boundedness of u imply boundedness of x?, or does u{t) ^ as t ^ cx) imply 
x{t) ^ as t ^ oo? And if yes, how does the initial state affect the bounds or convergence 
rates, respectively? 

There are two very conceptually different ways of formulating the notion of stability 
of control systems. One of them, which we may call the input/output approach, relies on 
operator-theoretic techniques. Among the main contributions to this area, one may cite the 
foundational work by Zames, Sandberg, Desoer, Safanov, Vidyasagar, and others, starting in 
the 1960s. In this approach, a "system" is a causal operator F between spaces of signals, and 
"stability" is taken to mean that F maps bounded inputs into bounded outputs, or finite- 
energy inputs into finite-energy outputs. More stringent typical requirements in this context 
are that the gain of F be finite (in more classical mathematical terms, that the operator 
be bounded), or that it have finite incremental gain (mathematically, that it be globally 
Lipschitz). The input /output approach has been extremely successful in the robustness 
analysis of linear systems subject to nonlinear feedback and mild nonlinear uncertainties, and 
in general in the area that revolves around the various versions of the small-gain theorem. 
Moreover, geometric characterizations of robustness (gap metric and the like) are elegantly 
carried out in this framework. Finally, i/o stability provides a natural setting in which to 
study the classification and parameterization of dynamic controllers. 

On the other hand, there is the model-based, or state-space approach, to systems and 
stability, where the basic object is a forced dynamical system, typically described by differ- 
ential or difference equations. In this approach, which is consistent with the way we have 
treated systems in the first part of this paper, there is a standard notion of stability, namely 
Lyapunov asymptotic stability of the unforced system (GAS). Associated to such a system, 
there is an operator F mapping inputs (forcing functions) into state trajectories (or into 
outputs, if partial measurements on states are of interest). It becomes of interest then to 
ask to what extent Lyapunov-like stability notions for a state-space system are related to the 
stability, in the senses discussed in the previous paragraph, of the associated operator F. It 
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is well-known that, in contrast to the case of linear systems, where there is -subject to mild 
technical assumptions- an equivalence between state-space and i/o stability, for nonlinear 
systems the two types of properties are not so closely related. Even for the very special 
and comparatively simple case of "feedback linearizable" systems, this relation is far more 
subtle than it might appear at first sight: if one first linearizes a system and then stabilizes 
the equivalent linearization, in terms of the original system one does not in general obtain 
a closed-loop system that is input/output stable in any reasonable sense. (However, it is 
always possible to make a choice of a — usually different — feedback law that achieves such 
stability, in the linearizable case as well as for all other stabilizable systems; see [35].) 

The work initiated in [35] elucidates the links between the two alternative paradigms of 
stability, i/o and state-space, through the systematic use of the notion of "input to state 
stability" (ISS). This notion differs fundamentally from the operator-theoretic ones that have 
been classically used in control theory, first of all because it takes account of initial states in a 
manner fully compatible with Lyapunov stability. Second, boundedness (finite gain) is far too 
strong a requirement for general nonlinear operators, and it must be replaced by "nonlinear 
gain estimates," in which the norms of output signals are bounded by a nonlinear function 
of the norms of inputs; the definition of ISS incorporates such gains in a natural way. 

The ISS concept has already proven useful in many applications; see e.g. [3, 10, 16, 18, 
19, 20, 24, 23, 29, 30, 31, 33, 46]. Moreover, this concept has many equivalent versions, 
which indicates that it is mathematically natural: there are characterizations in terms of 
dissipation, robustness margins, and classical Lyapunov- like functions; see e.g. [42, 43]. 

Informally, the ISS property translates into the statement: "no matter what is the initial 
state, if the inputs are uniformly small, then the state must eventually be small" . It gives no 
useful bounds in the situation in which inputs u{-) are unbounded but still have in some sense 
"finite energy". In [37], a new notion, that of integral input to state stability, iISS for short, 
was introduced, to model the statement: "no matter what is the initial state, if integrals of 
the inputs are small, then the state must eventually be small" . In this part of the paper, we 
will briefly survey both the ISS and iISS properties. 

Bounded inputs may give unbounded states 

To appreciate the type of problem that one may encounter, consider the following issue. 
Suppose that (1) is GAS, meaning, more precisely, that the trivial solution x = of the 
differential equation 

X = fo{x) = f{x,0) (43) 

is globally asymptotically stable. Then one would like to know if, for solutions of (1) associ- 
ated to nonzero controls, it holds that 

n(.)\0 ^ x(-)\0 

(the "converging input converging state" property) or that 

u{-) bounded ^ x{-) bounded 

(the "bounded input bounded state" property). Of course, for linear systems x = Ax + Bu 
these implications are always true. Not only that, but one has explicit estimates 

\x{t)\ < /3(t)|x''|+7||nt||oo 
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where 



/•oo 

(3(t) = ||e*^|| ^0 and 7 = \\B\\ / We'^Wds 

Jo 



for any Hurwitz matrix A, where ut is the restriction of u to [0, t], thought of as a measurable 
bounded function which is zero for s > t. From these estimates both properties can be easily 
deduced, see e.g. [36]. 

These implications fail in general for nonlinear systems, however, as has been often pointed 
out in the literature (see for instance [47]). As a trivial illustration, take the system 

X = -X + {x'^ + l)u (44) 

and the control u{t) = (2t + 2)^^'^. With xq = \pl there results the unbounded trajectory 
x{t^ = (2t + 2)-*^'^. This is in spite of the fact that the unforced system is GAS. Thus, the 
converging input converging state property does not hold. Even worse, the bounded input 
u = 1 results in a finite-time explosion. This example is not artificial, as it arises from the 
simplest case of feedback linearization design. Indeed, given the system 

i; = X + (x + l)n , 

the obvious stabilizing control law (obtained by first canceling the nonlinearity and then 
assigning dynamics x = — x) is 

-2x 

where v is the new external input. In terms of this new control (which might be required 
in order to meet additional design objectives, or may represent the effect of an input distur- 
bance), the closed- loop system is as in (44), and thus is ill-behaved. Observe, however, that 
if instead of the obvious law just given one would use: 

-2x 

u := -x + v, 

x^ + 1 

then the closed- loop system becomes instead (calling "t;" again "n"): 

X = — 2x — X + (x +l)n. 

This is still stable when n = 0, but in addition it tolerates perturbations far better, since the 
term — x^ dominates u(x^ + 1) for bounded u and large x. The behavior with respect to such 
u is characterized qualitatively by the notion of ISS system, to be discussed below. 

Motivation: Finite-Gain under Coordinate Changes 

The notions of ISS and iISS arise naturally when one attempts to generalize linear gain 
analysis to nonlinear systems. In order to motivate the definitions, we first review the classical 
case of linear systems 

X = Ax + Bu . 

There are two main norms which one usually imposes on input functions and state trajec- 
tories, namely square norms (to quantify energy) or supremum norms (to study worst-case 
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behavior). This gives rise to the following three possible estimates (the case "L°° -^ L^" is 
less interesting, being too restrictive): 

[L°°^L°°] |x(t)| < c|x(0)|e"^* + c sup |n(s)| for alH > , (45) 

sG[0,t] 

[l2^L°°] |x(t)| < c|x(0)|e~^* + c / |n(s)|^ ds for alH > , (46) 

Jo 

[L^^L^] f \x{s)\^ ds < c\x{0)\ + c [ \u{s)\^ ds for all t > . (47) 

Jo Jo 

(To be precise: there exist positive constants c and A so that, for each measurable essentially 
bounded control u and each initial condition, the solution of x = Ax + Bu is defined for all t 
and it satisfies the indicated estimates. Actually, most textbooks omit the initial states, but 
these are the appropriate formulations when nonzero initial states are taken into account.) 
It is not difficult to see that all these three properties are equivalent for linear systems, and 
in fact they amount to simply asking that the matrix A be Hurwitz (all eigenvalues have 
negative real parts). 

One may argue, however, that notions of stability should be invariant under changes of 
variables. Let us see what this requirement leads us to. Suppose that we take an origin- 
preserving state change of coordinates x = T{z) and an origin-preserving change of input 
variables u = S{v). That is, T : M" -^ R" and S : M™ -^ M"* are continuous and invertible, 
have continuous inverses, and T(0) = and S'(O) = 0. Then, there are two functions a,a G 
/Coo so that 

a{\z\) < \T{z)\ < a{\z\) 

for all z £ M", and, similarly, we can write |<S'(w)| < 7(|v|) for each v G M™, for some 7 G /Coo- 
For any input u and initial state x", and the corresponding trajectory x{t) = x{t,x°,u), let 
us write x(t) = T{z{t)) and u{t) = S{v{t)) for all t, and z° = z(0) = T~^(x°). Let us rewrite 
each of the estimates in terms of the z and v variables. 
Estimate (45) translates into: 

a{\z{t)\) < ce"^*a(|z"|) + c sup ^{\v{s)\) for alH > . 

se[o,i] 

If we use again "x" and "u" for state and input variables, and we let /3(s, t) := ce~'^*a(s) and 
7(s) := 07(5), we are led to an estimate as follows, where (3 G ICC, 7 G /Coo: 

a{\x{t)\) < /3(|x(0)|,t) + sup j{\u{s)\). (48) 

se[o,t] 

(This would appear to be less general, because (3 has a very special form. Surprisingly, 
however, any ICC function (3 can be majorized by a function of the special form ce~*Q(s), 
with Q G /Coo; see [37].) On the other hand, estimate (46) translates into: 

a{\z{t)\) < ce-^^ai\z"\) + c [ ^{\v{s)\f ds for ah t > . 

Jo 

With [3{s,t) := ce~^''a{s) and 7(5) := C7(s)^, we have now an estimate as follows:: 

a(|x(t)|) < /?(|x(0)|,t) + / 7{Hs)\)ds. (49) 

Jo 
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Finally, estimate (47) translates into: 

t rt 

ai\z{s)\))ds < ca(|z"|) + c / ^{\v{s)\f ds for all t > . 
Jo 

With 7(s) := 07(5)^ and k{s) := ca{s), invariance under change of variables in (47) leads to 
an estimate of the form: 

t ft 

a{\x{s)\)ds < k{\x'>\)+ / ji\u{s)\)ds. (50) 

Jo 

We now define any system (1) to be input to state stable (ISS) if there exist functions 
P £ ICC and a, 7 G /Coo so that, for each initial state x*^ and input u (measurable and 
locally essentially bounded), the solution x{t) = x{t,x^\u) is defined for all t > 0, and the 
estimate (48) holds. 

Similarly, we say that a system (1) is integral input to state stable (iISS) provided 
that there exist functions (3 G KC and a, 7 G /Cqo so that, for each initial state x'' and input 
u (measurable and locally essentially bounded), the solution x{t) = x{t,x^\u) is defined for 
all t > 0, and the estimate (49) holds. 

Regarding the last estimate, that in Equation (50) (what one might call a "nonlinear H^o 
estimate" in analogy to the linear case), we do not give it a name, because, as remarked 
below, it is the same as ISS. 

In summary, we have seen that the notions of ISS and iISS arise most naturally when 
one starts from standard stability notions for linear systems and applies nonlinear changes 
of variables. (Analogously, although this is not usually mentioned, Lyapunov's asymptotic 
stability can be seen as the notion which arises, via change of state variables, from exponential 
stability.) 

6.1 ISS 

Note that the estimate (48) can be rewritten as follows: there exist 7 G /Coo and fi G /C£ 
such that, for all inputs and initial states, 

\x{t)\ < /?(|x(0)|,t) + sup 7(k(s)l) (51) 

sG[0,t] 

or, equivalently (with slightly different comparison functions), 

\x{t)\ < maxJ/3(|x(0)|,t), sup l{\u{s)\)\ . (52) 

[ se[o,t] J 

(The equivalences follow from elementary properties of /Coo functions; for example, a{r) < 
P{s,t) + 7(t) implies r < a-^{(3{s,t) + 7(t)) < a-^i2(3{s,t)) + a-^{2-/{t)). Note that 
a-i(2/3(-, •)) G /C£ and a'^{2-f{-)) G /Coo-) 

Asymptotic Gain Characterization of ISS 

The estimate (52) implies that an ISS system must have a well-defined asymptotic gain, that 
is, there is some 7 G /Coo so that 

m\x{t,x°,u)\ < 7(lklloo) 
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Figure 19: Asymptotic gain: all trajectories tend to ball of radius determined by ||n||oo 

for all x° and u; see Figure 19. When u = 0, (52) reduces to \x{t)\ < /3(|x(0)|, t), a GAS 
estimate, so an ISS system has the property that the zero-input system (43) is GAS. Thus, an 
ISS system implies the properties: the zero-input system is GAS and there is an asymptotic 
gain. The first property is independent of inputs, and the second property involves no 
estimates on initial states. It is then surprising that ISS is in fact equivalent to the conjunction 
of these two properties, which represents a superposition principle for nonlinear control. 
Moreover, one can weaken the GAS assumption to simply (neutral) stability of the zero-input 
system (43), because the asymptotic gain property, when applied to the special case u = 0, 
already implies that all trajectories of (43) converge to zero (attractivity property). The 
result, which is nontrivial, is as follows, see [43]: 

Theorem H The system (1) is ISS if and only if it admits an asymptotic gain and the 
unforced system (43) is stable. 

We remark that the basic difficulty is in establishing uniform convergence estimates for the 
states (i.e., constructing the /? function). If the system were affine in u, the proof would follow 
from a more or less standard weak compactness argument; however, for general systems, the 
proof is far more delicate. 

Dissipation Characterization of ISS 

Another characterization of ISS is via Lyapunov-like notions. Let us say that a smooth 
V : M" — >■ M is an ISS-Lyapunov function for the system (1) if y is proper and positive 
definite, and, for some 7, a G /Coo, 

V{x,u) < -a{\x\) + -f{\u\) yx,u. (53) 

(Recall that we use the notation "y(x,ti)" to denote 'W{x).f{x,u).) In other words, along 
all trajectories of the system, we have the dissipation inequality 

V{xit2))-V{xiti)) < [\{uis),x{s))ds 

Jtl 

where, using the terminology of [48, 15], the "supply" function is w{u,x) = 7(|^i|) — a(|a:|). 
The following fundamental result is from [42]: 
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Theorem I The system (1) is IBS if and only if it admits an ISS-Lyapunov function. 

It is trivial to see that, if there is an ISS-Lyapunov function, then there is also one which 
satisfies an estimate of the type (with different comparison functions, of course): 

V{x,u) < -a{V{x))+-/{\u\) (54) 

or even (cf. [31], and also [36], Exercise 5.7.17) one of this form with a{r) = r, due to Praly 
and Wang: 

V{x,u) < -Vix)+-f{\u\). (55) 

The proof of one implication in Theorem I is not hard. If we are given a dissipation 
estimate (54), then either a{V{x)) < 27(|ti|) or F < —a(y)/2, and from here one deduces 
by a comparison theorem that 

V{x{t)) < max{/3(F(0),t),a-i(27(||n||))} 

where (3{s, t) = y{t) and y is obtained by solving the scalar initial value problem 

y = -2^{y) + i{u)^ y{o) = s. 

An estimate of the type (52) is immediate from here. 

The other implication takes a bit more effort. The critical observation is that ISS implies 
"small gain robustness": if u{t) is for all t sufficiently small compared to x{t), then the term 
involving u can be dropped from the right-hand side of (52). This leads to the property 
that there is some p G /Coo so that, defining g{x,d) := f{x,dp{x)), the system x = g{x,d) is 
asymptotically stable uniformly with respect to all measurable d{-) : M>o -^ M™ with values 
in a ball of radius one. One may then invoke the converse Lyapunov theorem for robust 
stability proved in [28] to obtain a smooth V so that 

VV{x) ■g{x,d) < -a{x) 

for all X and d, and an ISS-Lyapunov function can be obtained by slightly modifying this V. 

ISS Behaves Well Under Series Connections 

As a further motivation for the concept of ISS, and as an illustration of the characterizations 
given, we remark that any cascade (series connection) of ISS systems is again ISS. Consider 
a cascade connection 

z = f{z,x) 
X = g{x,u) 

as in Figure 20. If each system is separately ISS (the z system having x as its input), then 



Figure 20: Cascade 
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we know that there are ISS-Lyapunov functions for each. Moreover, one can find matching 
such functions Vj, in the sense that we have estimates: 



Vi(z,x) < ei\x\) - ai\z\) 

V2{x,u) < e{\u\) - 2e{\x\) 

(see [41]) and from here one has that W{x,z) := Vi{z) + V2{x) is an ISS-Lyapunov function 
for the composite system: 

Wix,z) < 9i\n\)-e{\x\)-ai\z\). 

More generally, if the input u is fed back with "small gain", for instance if u = k(z) is so that 
^(|it|) ^ (1 — e)a(|z|), then Ty(x, z) < — 0(|x|) — ea(|z|) and thus for such feedback the closed- 
loop system is GAS. This type of reasoning leads to the Small-Gain Theorem for ISS systems 
due to Jiang, Praly, and Teel, cf. [19], which implies that, under suitable conditions on gains, 
the closed loop system obtained from an interconnection of two ISS systems x = f{x,z,u) 
and z = g{z,x,v), see Figure 21, is itself ISS with respect to {u,v). 
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Figure 21: Feedback interconnection 



An Example 

As an example, we look at the problem of angular momentum stabilization of a rigid body 
controlled by two torques acting along principal axes (for instance, a satellite controlled by 
two opposing jet pairs). Using oj = {uji^uj2-,^^) to denote the angular velocity of a body- 
attached frame with respect to inertial coordinates, and / = diag(/i, /2, /s) to denote the 
principal moments of inertia, we obtain the equations: 
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We assume I2 7^ ^3; then, introducing new state and input coordinates via {I2 — H)xi = A"^!) 
X2 = W2, X3 = (J3, I2U1 = {I3 - Ii)ll>iuj2 + vi, and I3U2 = {h - /2)^i'^3 + V2, we obtain a 
system on M^, with controls in 



p2. 



Xl = X2X3 
±2 = Ul 
XZ = U2- 
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We claim that the following feedback law globally stabilizes the system: 

Ul = -Xl - X2 - X2X3 

U2 = -x:i + x\ + 2a:ia:2a;3 . 

This feedback was obtained in this way: with Z2 := xi + X2, Z3 := X3 — xf, the system 
becomes: 



Xl 


= 


-x\ + a{xi,Z2,z^ 


h 


= 


-Z2 


h 


= 


-zz 



The xi-subsystem is easily seen to be ISS, because deg^^ q < 2 and hence the cubic term 
dominates for large x\. Thus the cascade, which is the original system that we wanted to 
stabilize, is also ISS, and, in particular, is GAS when there are no inputs. (In fact, we proved 
a stronger result, in establishing the ISS property, providing a global robustness result with 
respect to actuator noise.) 

6.2 The i/00-Like Property 

Recall that the "L^ -^ L^" stability property in (47) led to an estimate of the form (50), more 
precisely, for each x'^ and u the solution is well-defined for alH > and (50) holds. (Actually, 
a weaker notion is obtained if one merely asks that the estimate should hold in the maximal 
interval of existence.) It is shown in [38] that this property holds i/ and only if the system 
is ISS. A sketch of a proof is as follows. If the system is ISS, then there is an ISS-Lyapunov 
function satisfying V{x,u) < —V{x) -|-7(|u|) (cf. Equation (55)), so, integrating, we obtain 

t i-t i-t 

Vix{s))ds < / Vix{s))ds + Vix{t)) < V{xiO)) + / -f{\u{s)\)ds 
Jo Jo 

and an estimate of the form (50) holds. Conversely, if such an estimate holds, ons can prove 
that x = f{x,0) is stable and that an asymptotic gain exists. We show here just the "limit 
property" infi>o|x(t)| < 0(||ti||oo)- Indeed, let 6 := a"^ 07. Suppose that inft>o|x(t)| > 
(a~^ o 7)(||ti||), so that there is some e > so that a{x{t)) > e + 7(u(t)) for all t > 0. Then, 
/o Q.{x{s))ds > et + Jq 7(w(s))ds, which implies k(|x°|) > et for all t, a contradiction. 

6.3 Integral Input-to-State Stability 

The "L^ -^ L°°" linear stability property (46) led us to the iISS estimate (49). As with the ISS 
property, there is an elegant dissipation characterization. Let us call a smooth V : M^ -^ R 
is an ilSS-Lyapunov function for the system (1) if V is proper and positive definite, and, for 
some 7 G /Coo and some positive definite a, 

V{x,u) < -a(|x|)+7(|n|) Vx,u (56) 

(the difference with (53) is that here we do not require a to be class /Coo)- A recent result, 
obtained in [1] by Angeli, Wang, and the author, is as follows: 

Theorem J The system (1) is iISS if and only if it admits an ilSS-Lyapunov function. 
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Notice that this imphes (since a /Coo function is in particular positive definite) that every 
ISS system is also iISS, but the converse is false, because for bounded but large u's one 
may well have V > 0. (Intuitively, on the other hand, 7(n) G C^ means that V is "often" 
negative.) As an example, take the system x = — tan~^x + u. This is iISS: take for instance 
V{x) = xtan~^x, so V^ < — (tan~^ l^^l)^ + 2 |u|, but it is not ISS, since u{t) = tt/2 results in 
unbounded trajectories. 

Several properties are known for the iISS property. For instance, a bilinear system x = 
(A + YllLi'^i^i)^ + ^"^ is iISS if and only if A is a Hurwitz matrix, see [38]. Many more 
properties are given in [1]. We pick just one of the most interesting ones here. 

A system (1) together with an output function y = h{x) (where h : M" ^ M^ is a 
continuous map, for some p, with /i(0) = 0) will be said here to be h-dissipative if there exists 
a smooth, positive definite, and proper function V : M" -^ M such that 

V{x,u) < -a{h{x)) + a{\u\) 

for all x,u, and weakly h-detectahle if, for all trajectories, y{t) = h{x{t)) = implies that 
x{t) -^ Q as t ^ oo. 

Theorem K The system (1) is iISS if and only if there is some output h so that the system 
is weakly h-detectahle and h-dissipative. 

7 Other Notions Related to ISS 

There are several notions, all of great interest in control, which arise when applying coordinate 
changes to classical linear concepts. We very briefly mention some of them here. 

Consider flrst systems x = f{x),y = h{x) with outputs but no inputs. Dualizing ISS by 
simply replacing "u" by "y" , there results the following estimate: 

|x(t,x")|</3(|x«|,t)+ sup 7(|y(5)l)- 
se[o,t] 

A system for which this property holds (along all maximal solutions) is said to be output 
to state stable (OSS). This property is precisely the appropriate version of detectability 
with respect to zero states, see [44]. More generally, one could have inputs and outputs, 
considering systems x = f{x,u),y = h{x). The obvious notion of detectability is then given 
by estimates of the type 

x{t) < /3(|x"|,t)+ sup 7i(|u(s)|)+ sup 72(|y(s)|) 
se[o,t] se[o,t\ 

("lOSS", for input/output to state stability). Several dissipation characterizations are dis- 
cussed in [44, 22]. 

A different notion is that of input-to-output stability (lOS), where we ask that all 
trajectories of a system with outputs must satisfy 

h{x{t,x'\u)) < p{\x°\,t)+ sup 7(1^(5)1) 

se[o,t] 

and 

\x{t,x",u)\ < max|cr(|x"|), sup3g[o,t]cr(^i(s))| 
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for all t, u, and x°, and for appropriate comparison functions. This is closely related to the 
concept of partial stability in differential equations (special case, when /i is a projection). 
It is the correct notion, it would appear, for formulating regulation and tracking problems. 
See [45] for Lyapunov-like dissipation characterizations. 
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